2024-09-19T08:23:57.056 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:23:57.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:23:57.175 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911854' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHexmL27u1GssvBvz+Uh7LwzIH2ohZ06LCUuoiWewiO1RI6GCWVi5cATuIrYpgnQuIL97mG8jzLcPR3FNlNm4M= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITPXgMoXFd46ica1meXYylhzMSFR2de7z8i7zg4buDPgUaJKRour7cVVstfLIzK6bVd22WmjHGs8hX6m9Piwa8= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKserycZS7j2PoO7AZnNFTd8HrByIcFmXP/v28nwkOytxuRGYUDHiVmoYVs9mFT4MOhwoymFH6L8xXv+f6YwDow= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:23:57.175 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:23:57.176 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:23:57.176 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:23:57.178 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:23:57.201 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:23:57.201 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:23:57.201 INFO:teuthology.packaging:ref: None 2024-09-19T08:23:57.201 INFO:teuthology.packaging:tag: None 2024-09-19T08:23:57.201 INFO:teuthology.packaging:branch: squid 2024-09-19T08:23:57.201 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:23:57.201 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:23:57.419 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:23:57.420 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:23:57.427 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:23:57.427 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:23:57.436 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:23:57.455 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:23:57.464 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:23:57.489 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:18:43.597400', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHexmL27u1GssvBvz+Uh7LwzIH2ohZ06LCUuoiWewiO1RI6GCWVi5cATuIrYpgnQuIL97mG8jzLcPR3FNlNm4M='} 2024-09-19T08:23:57.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:18:43.600920', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITPXgMoXFd46ica1meXYylhzMSFR2de7z8i7zg4buDPgUaJKRour7cVVstfLIzK6bVd22WmjHGs8hX6m9Piwa8='} 2024-09-19T08:23:57.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:18:43.599267', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKserycZS7j2PoO7AZnNFTd8HrByIcFmXP/v28nwkOytxuRGYUDHiVmoYVs9mFT4MOhwoymFH6L8xXv+f6YwDow='} 2024-09-19T08:23:57.533 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:23:57.574 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:23:57.574 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:23:57.574 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:23:57.575 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:23:57.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b7e0d7be0>, signals=[15]) 2024-09-19T08:23:57.688 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:23:57.695 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:23:57.695 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:23:57.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:23:57.776 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-19T08:23:57.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:23:57.856 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T08:23:57.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:23:57.940 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:23:57.947 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-19T08:23:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-19T08:23:57.967 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-19T08:23:58.025 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-19T08:23:58.025 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-19T08:23:58.026 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-19T08:23:58.026 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:23:58.026 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-19T08:23:58.026 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:23:58.026 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:23:58.026 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-19T08:23:58.027 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:23:58.027 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:23:58.027 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:23:58.027 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:23:58.027 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:23:58.028 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:23:58.029 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-19T08:23:58.052 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-19T08:23:58.072 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-19T08:23:58.072 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-19T08:23:58.130 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-09-19T08:23:58.130 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-09-19T08:23:58.130 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-09-19T08:23:58.130 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:23:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:23:58.132 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:23:58.132 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:23:58.132 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-19T08:23:58.153 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-19T08:23:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-19T08:23:58.172 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-19T08:23:58.230 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-19T08:23:58.230 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-19T08:23:58.230 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-19T08:23:58.230 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:23:58.230 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:23:58.231 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:23:58.231 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-19T08:23:58.252 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:23:58.266 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:23:58.281 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:23:58.281 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:23:58.284 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:23:58.286 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:23:58.303 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:23:58.312 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:23:58.313 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:23:58.341 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:23:58.344 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:23:58.444 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:23:58.523 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:23:58.547 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:23:58.547 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T08:23:58.547 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:23:58.548 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:23:58.549 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:23:58.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:23:58.567 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T08:23:58.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:23:58.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:23:58.569 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-19T08:23:58.570 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-19T08:23:58.625 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:23:58.626 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-503.el9.x86_64 2024-09-19T08:23:58.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-09-19T08:23:58.627 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:23:58.627 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-19T08:23:58.627 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-19T08:23:58.628 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:23:58.628 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.14.0-503.el9.x86_64 2024-09-19T08:23:58.629 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2024-09-19T08:24:00.842 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-19T08:24:01.902 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.3 MB 00:01 2024-09-19T08:24:02.150 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-19T08:24:02.693 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-19T08:24:07.936 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-19T08:24:08.302 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-19T08:24:09.886 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-19T08:24:10.806 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T08:24:14.411 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-19T08:24:16.128 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-19T08:24:16.254 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T08:24:17.058 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T08:24:18.144 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:24:18.144 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:24:18.225 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:24:18.234 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout:Install 4 Packages 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 79 M 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 126 M 2024-09-19T08:24:18.235 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-19T08:24:18.381 INFO:teuthology.orchestra.run.smithi150.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 286 kB/s | 36 kB 00:00 2024-09-19T08:24:20.289 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-19T08:24:22.523 INFO:teuthology.orchestra.run.smithi150.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-19T08:24:22.563 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T08:24:24.495 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:24:24.495 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:24:24.603 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:24:24.608 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:24:24.609 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 79 M 2024-09-19T08:24:24.610 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 126 M 2024-09-19T08:24:24.610 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T08:24:24.990 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 350 kB/s | 36 kB 00:00 2024-09-19T08:24:25.407 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-19T08:24:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-19T08:24:26.116 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-19T08:24:26.117 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:24:26.117 INFO:teuthology.orchestra.run.smithi018.stdout:Total 52 MB/s | 79 MB 00:01 2024-09-19T08:24:26.222 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-19T08:24:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T08:24:27.195 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T08:24:27.195 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T08:24:27.840 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-19T08:24:28.155 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T08:24:28.155 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T08:24:28.835 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T08:24:30.726 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T08:24:31.377 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:24:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:24:31.671 INFO:teuthology.orchestra.run.smithi150.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-19T08:24:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:24:34.324 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T08:24:34.472 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:24:34.821 INFO:teuthology.orchestra.run.smithi150.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-19T08:24:34.822 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:24:34.822 INFO:teuthology.orchestra.run.smithi150.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-19T08:24:35.508 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-19T08:24:35.855 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-19T08:24:35.855 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-19T08:24:36.214 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:24:36.215 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:24:36.300 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-19T08:24:36.312 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-19T08:24:36.312 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-19T08:24:36.312 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-19T08:24:36.312 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-19T08:24:36.312 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-19T08:24:36.313 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-19T08:24:36.492 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 466 kB/s | 36 kB 00:00 2024-09-19T08:24:36.816 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-19T08:24:36.816 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-19T08:24:39.273 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-19T08:24:39.584 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:24:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:24:39.909 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:24:39.997 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:24:40.500 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-19T08:24:42.757 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:24:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:24:43.849 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-19T08:24:44.751 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:24:45.508 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-19T08:24:45.508 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:24:45.508 INFO:teuthology.orchestra.run.smithi162.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-19T08:24:46.190 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-19T08:24:46.575 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-19T08:24:46.575 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-19T08:24:47.546 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-19T08:24:47.547 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-19T08:24:47.728 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:24:47.826 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:24:49.985 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-19T08:24:50.688 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:24:50.774 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:24:52.710 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:24:53.529 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:24:53.666 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:24:58.479 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:24:58.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:03.478 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:24.193 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:24.194 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:25:24.194 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:25:24.194 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:25:25.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:25:25.033 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T08:25:25.356 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:25.486 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:25.487 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:25.487 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:25:25.487 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:25:25.487 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:25:25.487 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T08:25:25.487 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:25:25.488 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:25.546 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:25.546 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:25.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-19T08:25:25.578 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-19T08:25:25.578 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:25:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:25:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:25:25.581 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:25:25.581 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:25:25.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:25:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-19T08:25:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:25:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-19T08:25:27.589 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-19T08:25:27.604 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.bQwL9dPZKs 2024-09-19T08:25:27.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bQwL9dPZKs 2024-09-19T08:25:27.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.bQwL9dPZKs 2024-09-19T08:25:27.826 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.bQwL9dPZKs is 6KB 2024-09-19T08:25:27.875 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.bQwL9dPZKs 2024-09-19T08:25:27.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:25:27.952 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:25:27.952 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:25:27.952 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:25:27.952 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:25:27.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:25:28.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-19T08:25:31.178 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:31.217 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:25:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:25:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:25:32.418 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:32.418 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:25:32.419 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-19T08:25:32.789 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:32.876 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:32.876 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:32.877 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:25:32.877 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:25:32.877 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:25:32.877 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T08:25:32.877 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:25:32.877 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:32.937 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:32.937 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:32.937 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-09-19T08:25:32.970 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 82.el9 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-09-19T08:25:32.971 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8274670 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-09-19T08:25:32.972 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:25:32.973 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:25:32.974 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:25:32.974 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:25:32.974 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:25:33.624 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-19T08:25:34.933 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:25:34.965 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-19T08:25:34.967 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-19T08:25:34.983 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.UEbwgcim89 2024-09-19T08:25:34.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UEbwgcim89 2024-09-19T08:25:35.051 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.UEbwgcim89 2024-09-19T08:25:35.189 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.UEbwgcim89 is 6KB 2024-09-19T08:25:35.238 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.UEbwgcim89 2024-09-19T08:25:35.254 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:25:35.317 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:25:35.317 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:25:35.318 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:25:35.318 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:25:35.319 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:25:35.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-19T08:25:35.547 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-09-19T08:25:41.952 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:41.995 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:25:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:25:42.376 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:25:43.187 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:25:43.188 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-19T08:25:43.560 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:43.651 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:43.652 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:43.652 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:25:43.652 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:25:43.652 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:25:43.652 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T08:25:43.652 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:25:43.652 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:43.711 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:43.711 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:43.712 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-19T08:25:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-19T08:25:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-19T08:25:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-19T08:25:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:25:43.747 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:25:43.748 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:25:43.749 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:25:43.749 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:25:43.750 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:25:44.412 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-19T08:25:45.718 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:25:45.748 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-19T08:25:45.750 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-19T08:25:45.771 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.iFcLlUWamm 2024-09-19T08:25:45.771 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iFcLlUWamm 2024-09-19T08:25:45.852 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.iFcLlUWamm 2024-09-19T08:25:45.999 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.iFcLlUWamm is 6KB 2024-09-19T08:25:46.048 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.iFcLlUWamm 2024-09-19T08:25:46.064 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:25:46.127 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:25:46.128 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:25:46.128 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:25:46.128 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:25:46.129 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:25:46.274 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-19T08:25:58.141 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T08:25:58.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T08:25:58.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:26:05.477 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T08:26:05.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-19T08:26:05.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:26:16.287 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T08:26:16.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T08:26:16.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:26:40.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-19T08:26:49.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-19T08:26:49.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:26:50.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-19T08:26:58.151 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:26:59.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T08:26:59.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:27:07.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T08:27:07.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:27:08.563 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T08:27:08.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T08:27:08.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:27:08.998 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T08:27:09.013 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:27:09.014 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:27:09.014 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:27:09.014 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:27:10.014 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T08:27:10.014 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:27:10.092 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-09-19T08:27:10.127 DEBUG:teuthology.parallel:result is None 2024-09-19T08:27:49.074 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:27:59.818 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:28:01.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-19T08:28:01.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:28:01.414 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-19T08:28:01.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-19T08:28:01.778 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:28:01.778 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-19T08:28:01.793 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:28:01.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:28:01.794 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:28:01.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:28:02.795 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T08:28:02.796 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:28:02.897 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-09-19T08:28:02.918 DEBUG:teuthology.parallel:result is None 2024-09-19T08:28:11.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T08:28:11.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:28:12.313 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-19T08:28:12.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T08:28:12.683 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:28:12.684 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-19T08:28:12.699 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:28:12.700 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:28:12.700 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:28:12.700 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:28:13.701 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T08:28:13.701 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:28:13.785 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-09-19T08:28:13.805 DEBUG:teuthology.parallel:result is None 2024-09-19T08:28:13.805 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:28:13.812 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:28:13.813 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:28:13.816 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:28:13.819 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:28:13.836 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:28:13.842 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:28:13.849 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:28:13.850 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:28:13.877 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:28:13.879 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:28:13.912 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:28:13.918 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:28:13.918 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:28:13.943 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:28:13.948 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:28:13.978 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:28:13.979 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:28:13.984 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:28:13.989 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:28:13.991 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:28:13.995 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:28:13.997 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:28:14.004 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:28:14.005 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:28:14.034 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:28:14.036 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:28:14.065 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:28:14.075 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:28:14.075 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:28:14.103 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:28:14.105 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:28:14.122 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:28:14.204 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:28:14.249 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:28:14.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:28:14.376 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:28:14.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:28:14.443 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:28:14.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:28:14.546 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:28:14.635 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:28:14.677 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:28:14.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:28:14.746 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:28:14.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:28:14.844 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:28:14.929 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:28:14.975 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:28:14.975 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:28:15.043 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-19T08:28:15.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-19T08:28:15.047 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-19T08:28:15.096 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:28:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:28:15.126 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:28:15.607 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:28:15.628 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:28:15.628 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:28:15.640 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:28:15.650 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:28:15.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-19T08:28:15.704 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-19T08:28:15.706 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-09-19T08:28:15.751 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-09-19T08:28:15.753 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-19T08:28:15.806 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-19T08:28:15.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:28:15.808 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-19T08:28:15.833 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-19T08:28:15.834 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-09-19T08:28:15.863 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-09-19T08:28:15.863 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-19T08:28:15.888 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-19T08:28:15.888 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:28:15.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:28:15.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:28:15.920 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:28:15.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:28:15.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:28:15.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:28:15.979 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:28:15.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:28:16.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:28:16.052 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:28:16.086 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:28:16.103 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:28:16.123 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:28:16.125 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi150.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:32:07.309 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-19T08:32:07.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T08:32:07.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:32:07.394 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T08:32:07.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T08:32:07.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-19T08:32:07.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:32:07.550 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-19T08:32:07.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-19T08:32:07.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T08:32:07.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:32:07.713 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-19T08:32:07.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T08:32:07.793 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:32:07.805 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:32:07.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:32:07.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:32:07.810 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:32:07.810 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:32:07.812 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:32:07.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:32:07.842 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:32:07.842 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:32:07.857 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:32:07.858 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:32:07.863 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:32:07.877 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:32:07.882 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-09-19T08:32:07.885 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-19T08:32:07.894 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-09-19T08:32:07.897 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-19T08:32:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-19T08:32:07.909 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:32:07.913 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:32:07.913 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-19T08:32:07.923 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:32:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:32:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:32:07.941 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:32:07.978 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:32:07.981 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:32:07.981 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-19T08:32:07.982 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.982 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.982 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.982 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.986 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:32:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:32:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T08:32:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.994 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:32:07.998 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:32:07.998 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T08:32:07.998 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.998 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.998 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.998 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:32:07.999 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:32:08.007 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:32:08.007 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:32:08.007 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:32:08.007 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:32:08.013 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:32:08.013 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:32:08.013 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:32:08.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:32:08.016 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:32:08.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:32:08.017 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:32:08.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:32:08.175 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:32:08.175 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:32:08.179 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:32:08.179 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:32:08.180 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:32:08.180 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:32:08.473 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:32:08.473 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:32:08.474 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:32:08.476 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:32:08.476 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:32:08.476 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:32:08.482 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:32:08.483 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:32:08.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:32:08.503 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:32:08.503 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:32:08.504 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:32:08.504 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:32:08.511 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:32:08.512 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:32:08.570 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:32:08.572 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:32:08.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:32:08.646 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:32:08.649 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:32:08.659 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:32:08.712 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-19T08:32:08.713 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-09-19T08:32:08.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-19T08:32:08.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-09-19T08:32:08.725 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-19T08:32:08.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-19T08:32:08.941 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-19T08:32:08.948 INFO:teuthology.orchestra.run.smithi150.stdout:45 files removed 2024-09-19T08:32:08.968 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:32:08.975 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:32:08.975 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-19T08:32:09.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:32:10.056 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 104 kB/s | 84 kB 00:00 2024-09-19T08:32:10.057 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 105 kB/s | 84 kB 00:00 2024-09-19T08:32:10.073 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 108 kB/s | 84 kB 00:00 2024-09-19T08:32:10.574 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-09-19T08:32:10.581 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-09-19T08:32:10.583 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-09-19T08:32:11.299 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-09-19T08:32:11.309 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-09-19T08:32:11.315 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-09-19T08:32:11.765 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-19T08:32:11.925 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T08:32:11.969 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T08:32:13.710 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-19T08:32:13.825 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:00 2024-09-19T08:32:13.861 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-19T08:32:17.869 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-19T08:32:18.310 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T08:32:19.175 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-19T08:32:19.511 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-19T08:32:20.043 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-19T08:32:20.666 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T08:32:20.767 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-19T08:32:21.106 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-19T08:32:21.680 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T08:32:26.105 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:32:26.771 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-19T08:32:27.077 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-19T08:32:28.301 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:28.302 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:28.316 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:32:28.316 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:32:28.317 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:32:28.318 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:32:28.320 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:32:28.323 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:32:28.324 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:32:28.388 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-19T08:32:28.414 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================== 2024-09-19T08:32:28.414 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-19T08:32:28.414 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================== 2024-09-19T08:32:28.414 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-19T08:32:28.414 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:32:28.415 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:32:28.417 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:32:28.418 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:32:28.419 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:32:28.420 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:32:28.421 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:32:28.422 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:32:28.423 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:32:28.424 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:32:28.425 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:32:28.426 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:32:28.427 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================== 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout:Install 148 Packages 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 8 Packages 2024-09-19T08:32:28.428 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:32:28.429 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 226 M 2024-09-19T08:32:28.429 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-19T08:32:29.048 INFO:teuthology.orchestra.run.smithi150.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-19T08:32:29.049 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:29.049 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:29.061 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:32:29.062 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:32:29.063 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:32:29.064 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:32:29.065 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:32:29.068 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:32:29.069 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:32:29.136 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T08:32:29.146 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:32:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:32:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:32:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:32:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:32:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:32:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:32:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:32:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:32:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:32:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:32:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout:Install 148 Packages 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-19T08:32:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:32:29.160 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 226 M 2024-09-19T08:32:29.160 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T08:32:29.245 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:29.246 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:29.257 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:32:29.258 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:32:29.258 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:32:29.259 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:32:29.261 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:32:29.263 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:32:29.264 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:32:29.327 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:32:29.342 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:32:29.344 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-19T08:32:29.345 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:32:29.346 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:32:29.347 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:32:29.348 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:32:29.349 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:32:29.350 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:32:29.351 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:32:29.352 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:32:29.353 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:32:29.354 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:32:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:32:29.356 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-19T08:32:29.357 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:32:29.358 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 226 M 2024-09-19T08:32:29.358 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-19T08:32:29.932 INFO:teuthology.orchestra.run.smithi150.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 896 kB 00:00 2024-09-19T08:32:29.962 INFO:teuthology.orchestra.run.smithi162.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 27 kB/s | 6.6 kB 00:00 2024-09-19T08:32:30.063 INFO:teuthology.orchestra.run.smithi018.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 25 kB/s | 6.6 kB 00:00 2024-09-19T08:32:30.065 INFO:teuthology.orchestra.run.smithi150.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T08:32:31.353 INFO:teuthology.orchestra.run.smithi162.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 644 kB/s | 896 kB 00:01 2024-09-19T08:32:31.372 INFO:teuthology.orchestra.run.smithi018.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 685 kB/s | 896 kB 00:01 2024-09-19T08:32:31.449 INFO:teuthology.orchestra.run.smithi150.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-09-19T08:32:31.520 INFO:teuthology.orchestra.run.smithi162.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 872 kB/s | 145 kB 00:00 2024-09-19T08:32:31.522 INFO:teuthology.orchestra.run.smithi018.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 969 kB/s | 145 kB 00:00 2024-09-19T08:32:31.807 INFO:teuthology.orchestra.run.smithi150.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 5.4 MB 00:02 2024-09-19T08:32:32.341 INFO:teuthology.orchestra.run.smithi150.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 1.5 MB 00:00 2024-09-19T08:32:32.964 INFO:teuthology.orchestra.run.smithi018.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-09-19T08:32:33.383 INFO:teuthology.orchestra.run.smithi150.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 3.0 MB/s | 4.7 MB 00:01 2024-09-19T08:32:33.464 INFO:teuthology.orchestra.run.smithi018.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.0 MB/s | 1.5 MB 00:00 2024-09-19T08:32:33.562 INFO:teuthology.orchestra.run.smithi162.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.2 MB/s | 2.4 MB 00:02 2024-09-19T08:32:33.689 INFO:teuthology.orchestra.run.smithi018.stdout:(6/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 5.4 MB 00:03 2024-09-19T08:32:34.420 INFO:teuthology.orchestra.run.smithi162.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 5.4 MB 00:04 2024-09-19T08:32:34.673 INFO:teuthology.orchestra.run.smithi018.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 3.9 MB/s | 4.7 MB 00:01 2024-09-19T08:32:34.829 INFO:teuthology.orchestra.run.smithi162.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 1.2 MB/s | 1.5 MB 00:01 2024-09-19T08:32:34.916 INFO:teuthology.orchestra.run.smithi150.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.5 MB/s | 21 MB 00:05 2024-09-19T08:32:35.016 INFO:teuthology.orchestra.run.smithi150.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 252 kB/s | 25 kB 00:00 2024-09-19T08:32:35.398 INFO:teuthology.orchestra.run.smithi018.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.8 MB/s | 21 MB 00:05 2024-09-19T08:32:35.473 INFO:teuthology.orchestra.run.smithi018.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 336 kB/s | 25 kB 00:00 2024-09-19T08:32:36.832 INFO:teuthology.orchestra.run.smithi018.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.9 MB/s | 11 MB 00:02 2024-09-19T08:32:37.141 INFO:teuthology.orchestra.run.smithi150.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 2.8 MB/s | 11 MB 00:03 2024-09-19T08:32:37.300 INFO:teuthology.orchestra.run.smithi150.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 17 MB 00:04 2024-09-19T08:32:37.325 INFO:teuthology.orchestra.run.smithi150.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T08:32:37.375 INFO:teuthology.orchestra.run.smithi150.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 360 kB/s | 27 kB 00:00 2024-09-19T08:32:37.401 INFO:teuthology.orchestra.run.smithi150.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 423 kB/s | 32 kB 00:00 2024-09-19T08:32:37.492 INFO:teuthology.orchestra.run.smithi150.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T08:32:37.520 INFO:teuthology.orchestra.run.smithi162.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 1.5 MB/s | 4.7 MB 00:03 2024-09-19T08:32:37.585 INFO:teuthology.orchestra.run.smithi150.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.3 MB/s | 127 kB 00:00 2024-09-19T08:32:37.598 INFO:teuthology.orchestra.run.smithi018.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 298 kB/s | 228 kB 00:00 2024-09-19T08:32:37.699 INFO:teuthology.orchestra.run.smithi018.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 270 kB/s | 27 kB 00:00 2024-09-19T08:32:37.726 INFO:teuthology.orchestra.run.smithi150.stdout:(17/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.1 MB/s | 751 kB 00:00 2024-09-19T08:32:37.790 INFO:teuthology.orchestra.run.smithi018.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 347 kB/s | 32 kB 00:00 2024-09-19T08:32:37.818 INFO:teuthology.orchestra.run.smithi150.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 2.1 MB/s | 506 kB 00:00 2024-09-19T08:32:37.893 INFO:teuthology.orchestra.run.smithi150.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 602 kB/s | 45 kB 00:00 2024-09-19T08:32:37.986 INFO:teuthology.orchestra.run.smithi150.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.4 MB/s | 136 kB 00:00 2024-09-19T08:32:38.007 INFO:teuthology.orchestra.run.smithi018.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 3.4 MB/s | 751 kB 00:00 2024-09-19T08:32:38.061 INFO:teuthology.orchestra.run.smithi150.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T08:32:38.091 INFO:teuthology.orchestra.run.smithi018.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T08:32:38.166 INFO:teuthology.orchestra.run.smithi018.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.7 MB/s | 127 kB 00:00 2024-09-19T08:32:38.211 INFO:teuthology.orchestra.run.smithi150.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 2.1 MB/s | 320 kB 00:00 2024-09-19T08:32:38.308 INFO:teuthology.orchestra.run.smithi018.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 3.5 MB/s | 506 kB 00:00 2024-09-19T08:32:38.353 INFO:teuthology.orchestra.run.smithi150.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.1 MB/s | 300 kB 00:00 2024-09-19T08:32:38.437 INFO:teuthology.orchestra.run.smithi150.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T08:32:38.521 INFO:teuthology.orchestra.run.smithi150.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-19T08:32:39.271 INFO:teuthology.orchestra.run.smithi150.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 3.5 MB/s | 5.3 MB 00:01 2024-09-19T08:32:39.367 INFO:teuthology.orchestra.run.smithi018.stdout:(18/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 13 MB/s | 49 MB 00:03 2024-09-19T08:32:39.371 INFO:teuthology.orchestra.run.smithi150.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T08:32:39.421 INFO:teuthology.orchestra.run.smithi150.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 3.4 MB/s | 3.1 MB 00:00 2024-09-19T08:32:39.442 INFO:teuthology.orchestra.run.smithi018.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 604 kB/s | 45 kB 00:00 2024-09-19T08:32:39.448 INFO:teuthology.orchestra.run.smithi150.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 423 kB/s | 32 kB 00:00 2024-09-19T08:32:39.505 INFO:teuthology.orchestra.run.smithi150.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T08:32:39.526 INFO:teuthology.orchestra.run.smithi018.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T08:32:39.668 INFO:teuthology.orchestra.run.smithi018.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 3.9 MB/s | 5.3 MB 00:01 2024-09-19T08:32:39.693 INFO:teuthology.orchestra.run.smithi018.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 968 kB/s | 161 kB 00:00 2024-09-19T08:32:39.785 INFO:teuthology.orchestra.run.smithi018.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.2 MB/s | 300 kB 00:00 2024-09-19T08:32:39.810 INFO:teuthology.orchestra.run.smithi018.stdout:(24/156): python3-rados-19.1.1-361.g2f599a46.el 2.2 MB/s | 320 kB 00:00 2024-09-19T08:32:39.860 INFO:teuthology.orchestra.run.smithi018.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T08:32:39.886 INFO:teuthology.orchestra.run.smithi018.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T08:32:39.970 INFO:teuthology.orchestra.run.smithi018.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T08:32:40.053 INFO:teuthology.orchestra.run.smithi018.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 382 kB/s | 32 kB 00:00 2024-09-19T08:32:40.170 INFO:teuthology.orchestra.run.smithi018.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-19T08:32:40.195 INFO:teuthology.orchestra.run.smithi018.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.0 MB/s | 146 kB 00:00 2024-09-19T08:32:40.347 INFO:teuthology.orchestra.run.smithi150.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 4.0 MB/s | 3.6 MB 00:00 2024-09-19T08:32:40.439 INFO:teuthology.orchestra.run.smithi150.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T08:32:40.480 INFO:teuthology.orchestra.run.smithi018.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T08:32:40.522 INFO:teuthology.orchestra.run.smithi150.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 592 kB/s | 49 kB 00:00 2024-09-19T08:32:40.562 INFO:teuthology.orchestra.run.smithi018.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T08:32:40.606 INFO:teuthology.orchestra.run.smithi150.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 197 kB/s | 16 kB 00:00 2024-09-19T08:32:40.638 INFO:teuthology.orchestra.run.smithi018.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 656 kB/s | 49 kB 00:00 2024-09-19T08:32:40.722 INFO:teuthology.orchestra.run.smithi018.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 197 kB/s | 16 kB 00:00 2024-09-19T08:32:40.740 INFO:teuthology.orchestra.run.smithi150.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.1 MB/s | 285 kB 00:00 2024-09-19T08:32:40.920 INFO:teuthology.orchestra.run.smithi018.stdout:(35/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 2.3 MB/s | 17 MB 00:07 2024-09-19T08:32:40.947 INFO:teuthology.orchestra.run.smithi018.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 285 kB 00:00 2024-09-19T08:32:41.014 INFO:teuthology.orchestra.run.smithi018.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 273 kB/s | 18 kB 00:00 2024-09-19T08:32:41.148 INFO:teuthology.orchestra.run.smithi018.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 3.3 MB/s | 765 kB 00:00 2024-09-19T08:32:41.207 INFO:teuthology.orchestra.run.smithi150.stdout:(36/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 7.9 MB/s | 49 MB 00:06 2024-09-19T08:32:41.249 INFO:teuthology.orchestra.run.smithi150.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 1.5 MB/s | 765 kB 00:00 2024-09-19T08:32:41.283 INFO:teuthology.orchestra.run.smithi150.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 243 kB/s | 18 kB 00:00 2024-09-19T08:32:41.366 INFO:teuthology.orchestra.run.smithi150.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 683 kB/s | 80 kB 00:00 2024-09-19T08:32:41.424 INFO:teuthology.orchestra.run.smithi150.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:32:41.458 INFO:teuthology.orchestra.run.smithi150.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-19T08:32:41.473 INFO:teuthology.orchestra.run.smithi018.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 174 kB/s | 80 kB 00:00 2024-09-19T08:32:41.501 INFO:teuthology.orchestra.run.smithi150.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T08:32:41.592 INFO:teuthology.orchestra.run.smithi150.stdout:(43/156): ceph-mgr-diskprediction-local-19.1.1- 3.5 MB/s | 7.4 MB 00:02 2024-09-19T08:32:41.617 INFO:teuthology.orchestra.run.smithi150.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 913 kB/s | 106 kB 00:00 2024-09-19T08:32:41.659 INFO:teuthology.orchestra.run.smithi150.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T08:32:41.665 INFO:teuthology.orchestra.run.smithi018.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 5.0 MB/s | 7.4 MB 00:01 2024-09-19T08:32:41.701 INFO:teuthology.orchestra.run.smithi150.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-19T08:32:41.726 INFO:teuthology.orchestra.run.smithi150.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-19T08:32:41.756 INFO:teuthology.orchestra.run.smithi018.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 674 kB/s | 191 kB 00:00 2024-09-19T08:32:41.793 INFO:teuthology.orchestra.run.smithi150.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-19T08:32:41.902 INFO:teuthology.orchestra.run.smithi150.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-19T08:32:41.927 INFO:teuthology.orchestra.run.smithi150.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 801 kB/s | 107 kB 00:00 2024-09-19T08:32:41.952 INFO:teuthology.orchestra.run.smithi150.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-19T08:32:41.986 INFO:teuthology.orchestra.run.smithi150.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-19T08:32:42.011 INFO:teuthology.orchestra.run.smithi150.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-19T08:32:42.028 INFO:teuthology.orchestra.run.smithi162.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 2.4 MB/s | 11 MB 00:04 2024-09-19T08:32:42.052 INFO:teuthology.orchestra.run.smithi150.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-09-19T08:32:42.092 INFO:teuthology.orchestra.run.smithi162.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T08:32:42.093 INFO:teuthology.orchestra.run.smithi150.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T08:32:42.093 INFO:teuthology.orchestra.run.smithi018.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 881 kB/s | 801 kB 00:00 2024-09-19T08:32:42.093 INFO:teuthology.orchestra.run.smithi018.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-19T08:32:42.104 INFO:teuthology.orchestra.run.smithi150.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 218 kB/s | 11 kB 00:00 2024-09-19T08:32:42.129 INFO:teuthology.orchestra.run.smithi150.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T08:32:42.154 INFO:teuthology.orchestra.run.smithi150.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-19T08:32:42.166 INFO:teuthology.orchestra.run.smithi018.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-19T08:32:42.188 INFO:teuthology.orchestra.run.smithi150.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T08:32:42.222 INFO:teuthology.orchestra.run.smithi150.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-19T08:32:42.233 INFO:teuthology.orchestra.run.smithi018.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 951 kB/s | 135 kB 00:00 2024-09-19T08:32:42.247 INFO:teuthology.orchestra.run.smithi150.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-19T08:32:42.272 INFO:teuthology.orchestra.run.smithi150.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-19T08:32:42.274 INFO:teuthology.orchestra.run.smithi018.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-19T08:32:42.297 INFO:teuthology.orchestra.run.smithi150.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T08:32:42.323 INFO:teuthology.orchestra.run.smithi150.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T08:32:42.325 INFO:teuthology.orchestra.run.smithi018.stdout:(47/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 384 kB/s | 253 kB 00:00 2024-09-19T08:32:42.348 INFO:teuthology.orchestra.run.smithi150.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-19T08:32:42.350 INFO:teuthology.orchestra.run.smithi018.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-19T08:32:42.398 INFO:teuthology.orchestra.run.smithi150.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-09-19T08:32:42.409 INFO:teuthology.orchestra.run.smithi018.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-09-19T08:32:42.434 INFO:teuthology.orchestra.run.smithi018.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-19T08:32:42.465 INFO:teuthology.orchestra.run.smithi150.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T08:32:42.485 INFO:teuthology.orchestra.run.smithi018.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-09-19T08:32:42.501 INFO:teuthology.orchestra.run.smithi018.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 235 kB/s | 22 kB 00:00 2024-09-19T08:32:42.532 INFO:teuthology.orchestra.run.smithi150.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-19T08:32:42.535 INFO:teuthology.orchestra.run.smithi018.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-19T08:32:42.569 INFO:teuthology.orchestra.run.smithi018.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-19T08:32:42.599 INFO:teuthology.orchestra.run.smithi150.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T08:32:42.602 INFO:teuthology.orchestra.run.smithi018.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-19T08:32:42.619 INFO:teuthology.orchestra.run.smithi018.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T08:32:42.624 INFO:teuthology.orchestra.run.smithi150.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T08:32:42.658 INFO:teuthology.orchestra.run.smithi150.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-19T08:32:42.686 INFO:teuthology.orchestra.run.smithi018.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-19T08:32:42.700 INFO:teuthology.orchestra.run.smithi150.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T08:32:42.711 INFO:teuthology.orchestra.run.smithi018.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 494 kB/s | 45 kB 00:00 2024-09-19T08:32:42.725 INFO:teuthology.orchestra.run.smithi150.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T08:32:42.767 INFO:teuthology.orchestra.run.smithi150.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T08:32:42.803 INFO:teuthology.orchestra.run.smithi018.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T08:32:42.851 INFO:teuthology.orchestra.run.smithi150.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T08:32:42.853 INFO:teuthology.orchestra.run.smithi018.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-19T08:32:42.862 INFO:teuthology.orchestra.run.smithi162.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 2.1 MB/s | 17 MB 00:08 2024-09-19T08:32:42.876 INFO:teuthology.orchestra.run.smithi150.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T08:32:42.901 INFO:teuthology.orchestra.run.smithi150.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-19T08:32:42.904 INFO:teuthology.orchestra.run.smithi018.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-19T08:32:42.918 INFO:teuthology.orchestra.run.smithi150.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-19T08:32:42.929 INFO:teuthology.orchestra.run.smithi018.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-19T08:32:42.935 INFO:teuthology.orchestra.run.smithi150.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-09-19T08:32:42.960 INFO:teuthology.orchestra.run.smithi150.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-19T08:32:42.977 INFO:teuthology.orchestra.run.smithi150.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 833 kB/s | 35 kB 00:00 2024-09-19T08:32:42.987 INFO:teuthology.orchestra.run.smithi162.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.8 MB/s | 228 kB 00:00 2024-09-19T08:32:43.013 INFO:teuthology.orchestra.run.smithi018.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-19T08:32:43.038 INFO:teuthology.orchestra.run.smithi018.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T08:32:43.061 INFO:teuthology.orchestra.run.smithi150.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-19T08:32:43.062 INFO:teuthology.orchestra.run.smithi162.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 360 kB/s | 27 kB 00:00 2024-09-19T08:32:43.086 INFO:teuthology.orchestra.run.smithi150.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T08:32:43.096 INFO:teuthology.orchestra.run.smithi018.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2024-09-19T08:32:43.112 INFO:teuthology.orchestra.run.smithi150.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:32:43.122 INFO:teuthology.orchestra.run.smithi018.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-19T08:32:43.137 INFO:teuthology.orchestra.run.smithi150.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:32:43.137 INFO:teuthology.orchestra.run.smithi162.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 424 kB/s | 32 kB 00:00 2024-09-19T08:32:43.154 INFO:teuthology.orchestra.run.smithi150.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T08:32:43.179 INFO:teuthology.orchestra.run.smithi150.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-19T08:32:43.204 INFO:teuthology.orchestra.run.smithi150.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T08:32:43.230 INFO:teuthology.orchestra.run.smithi150.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T08:32:43.247 INFO:teuthology.orchestra.run.smithi150.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T08:32:43.264 INFO:teuthology.orchestra.run.smithi150.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T08:32:43.297 INFO:teuthology.orchestra.run.smithi150.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T08:32:43.305 INFO:teuthology.orchestra.run.smithi018.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 8.7 MB/s | 1.6 MB 00:00 2024-09-19T08:32:43.364 INFO:teuthology.orchestra.run.smithi150.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-19T08:32:43.373 INFO:teuthology.orchestra.run.smithi018.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-19T08:32:43.381 INFO:teuthology.orchestra.run.smithi150.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 530 kB/s | 44 kB 00:00 2024-09-19T08:32:43.406 INFO:teuthology.orchestra.run.smithi150.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-19T08:32:43.421 INFO:teuthology.orchestra.run.smithi162.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.6 MB/s | 751 kB 00:00 2024-09-19T08:32:43.423 INFO:teuthology.orchestra.run.smithi150.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 857 kB/s | 36 kB 00:00 2024-09-19T08:32:43.440 INFO:teuthology.orchestra.run.smithi150.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T08:32:43.456 INFO:teuthology.orchestra.run.smithi018.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-19T08:32:43.465 INFO:teuthology.orchestra.run.smithi150.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-19T08:32:43.482 INFO:teuthology.orchestra.run.smithi150.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T08:32:43.490 INFO:teuthology.orchestra.run.smithi018.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-19T08:32:43.496 INFO:teuthology.orchestra.run.smithi162.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T08:32:43.507 INFO:teuthology.orchestra.run.smithi150.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-19T08:32:43.524 INFO:teuthology.orchestra.run.smithi150.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-19T08:32:43.541 INFO:teuthology.orchestra.run.smithi150.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-19T08:32:43.572 INFO:teuthology.orchestra.run.smithi162.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.6 MB/s | 127 kB 00:00 2024-09-19T08:32:43.615 INFO:teuthology.orchestra.run.smithi018.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-19T08:32:43.698 INFO:teuthology.orchestra.run.smithi018.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T08:32:43.722 INFO:teuthology.orchestra.run.smithi162.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 3.3 MB/s | 506 kB 00:00 2024-09-19T08:32:43.758 INFO:teuthology.orchestra.run.smithi150.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T08:32:43.799 INFO:teuthology.orchestra.run.smithi018.stdout:(73/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2024-09-19T08:32:43.809 INFO:teuthology.orchestra.run.smithi150.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:32:43.842 INFO:teuthology.orchestra.run.smithi150.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T08:32:43.866 INFO:teuthology.orchestra.run.smithi018.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 921 kB/s | 61 kB 00:00 2024-09-19T08:32:43.867 INFO:teuthology.orchestra.run.smithi150.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-19T08:32:43.941 INFO:teuthology.orchestra.run.smithi018.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-19T08:32:43.959 INFO:teuthology.orchestra.run.smithi150.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2024-09-19T08:32:44.016 INFO:teuthology.orchestra.run.smithi018.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-19T08:32:44.026 INFO:teuthology.orchestra.run.smithi150.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-19T08:32:44.050 INFO:teuthology.orchestra.run.smithi018.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-19T08:32:44.051 INFO:teuthology.orchestra.run.smithi150.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-19T08:32:44.077 INFO:teuthology.orchestra.run.smithi150.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-09-19T08:32:44.102 INFO:teuthology.orchestra.run.smithi150.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T08:32:44.125 INFO:teuthology.orchestra.run.smithi018.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-19T08:32:44.127 INFO:teuthology.orchestra.run.smithi150.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T08:32:44.151 INFO:teuthology.orchestra.run.smithi018.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 191 kB/s | 26 kB 00:00 2024-09-19T08:32:44.164 INFO:teuthology.orchestra.run.smithi162.stdout:(18/156): ceph-common-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 21 MB 00:14 2024-09-19T08:32:44.178 INFO:teuthology.orchestra.run.smithi150.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T08:32:44.184 INFO:teuthology.orchestra.run.smithi018.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-09-19T08:32:44.203 INFO:teuthology.orchestra.run.smithi150.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-19T08:32:44.228 INFO:teuthology.orchestra.run.smithi150.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 863 kB/s | 43 kB 00:00 2024-09-19T08:32:44.234 INFO:teuthology.orchestra.run.smithi018.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-19T08:32:44.239 INFO:teuthology.orchestra.run.smithi162.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 605 kB/s | 45 kB 00:00 2024-09-19T08:32:44.254 INFO:teuthology.orchestra.run.smithi150.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-19T08:32:44.268 INFO:teuthology.orchestra.run.smithi018.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-19T08:32:44.279 INFO:teuthology.orchestra.run.smithi150.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T08:32:44.304 INFO:teuthology.orchestra.run.smithi150.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:32:44.315 INFO:teuthology.orchestra.run.smithi162.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T08:32:44.338 INFO:teuthology.orchestra.run.smithi150.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T08:32:44.351 INFO:teuthology.orchestra.run.smithi018.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T08:32:44.363 INFO:teuthology.orchestra.run.smithi150.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T08:32:44.377 INFO:teuthology.orchestra.run.smithi018.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-19T08:32:44.388 INFO:teuthology.orchestra.run.smithi150.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:32:44.422 INFO:teuthology.orchestra.run.smithi150.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T08:32:44.439 INFO:teuthology.orchestra.run.smithi150.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 640 kB/s | 11 kB 00:00 2024-09-19T08:32:44.448 INFO:teuthology.orchestra.run.smithi162.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.2 MB/s | 161 kB 00:00 2024-09-19T08:32:44.460 INFO:teuthology.orchestra.run.smithi018.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-19T08:32:44.464 INFO:teuthology.orchestra.run.smithi150.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-19T08:32:44.550 INFO:teuthology.orchestra.run.smithi018.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 245 kB/s | 42 kB 00:00 2024-09-19T08:32:44.578 INFO:teuthology.orchestra.run.smithi018.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 342 kB/s | 77 kB 00:00 2024-09-19T08:32:44.581 INFO:teuthology.orchestra.run.smithi150.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-09-19T08:32:44.606 INFO:teuthology.orchestra.run.smithi150.stdout:(126/156): protobuf-compiler-3.14.0-13.el9.x86_ 811 kB/s | 863 kB 00:01 2024-09-19T08:32:44.632 INFO:teuthology.orchestra.run.smithi150.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T08:32:44.632 INFO:teuthology.orchestra.run.smithi162.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 1.7 MB/s | 320 kB 00:00 2024-09-19T08:32:44.636 INFO:teuthology.orchestra.run.smithi018.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-09-19T08:32:44.649 INFO:teuthology.orchestra.run.smithi150.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 471 kB/s | 20 kB 00:00 2024-09-19T08:32:44.662 INFO:teuthology.orchestra.run.smithi018.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-19T08:32:44.674 INFO:teuthology.orchestra.run.smithi150.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:32:44.687 INFO:teuthology.orchestra.run.smithi018.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-19T08:32:44.712 INFO:teuthology.orchestra.run.smithi018.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-19T08:32:44.724 INFO:teuthology.orchestra.run.smithi150.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-19T08:32:44.746 INFO:teuthology.orchestra.run.smithi018.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-09-19T08:32:44.749 INFO:teuthology.orchestra.run.smithi150.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-19T08:32:44.765 INFO:teuthology.orchestra.run.smithi162.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 300 kB 00:00 2024-09-19T08:32:44.766 INFO:teuthology.orchestra.run.smithi150.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T08:32:44.779 INFO:teuthology.orchestra.run.smithi018.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-19T08:32:44.800 INFO:teuthology.orchestra.run.smithi150.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.2 MB/s | 1.0 MB 00:00 2024-09-19T08:32:44.817 INFO:teuthology.orchestra.run.smithi150.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 329 kB/s | 16 kB 00:00 2024-09-19T08:32:44.821 INFO:teuthology.orchestra.run.smithi018.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-19T08:32:44.834 INFO:teuthology.orchestra.run.smithi150.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-19T08:32:44.840 INFO:teuthology.orchestra.run.smithi162.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T08:32:44.859 INFO:teuthology.orchestra.run.smithi150.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T08:32:44.876 INFO:teuthology.orchestra.run.smithi150.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-09-19T08:32:44.880 INFO:teuthology.orchestra.run.smithi018.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-19T08:32:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-19T08:32:44.909 INFO:teuthology.orchestra.run.smithi150.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-19T08:32:44.916 INFO:teuthology.orchestra.run.smithi162.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T08:32:44.926 INFO:teuthology.orchestra.run.smithi150.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T08:32:44.943 INFO:teuthology.orchestra.run.smithi150.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-19T08:32:44.964 INFO:teuthology.orchestra.run.smithi018.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-19T08:32:44.968 INFO:teuthology.orchestra.run.smithi150.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-19T08:32:44.994 INFO:teuthology.orchestra.run.smithi150.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-19T08:32:45.014 INFO:teuthology.orchestra.run.smithi018.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T08:32:45.019 INFO:teuthology.orchestra.run.smithi150.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:32:45.039 INFO:teuthology.orchestra.run.smithi018.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-09-19T08:32:45.053 INFO:teuthology.orchestra.run.smithi150.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-19T08:32:45.078 INFO:teuthology.orchestra.run.smithi150.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-19T08:32:45.103 INFO:teuthology.orchestra.run.smithi150.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:32:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 958 kB/s | 64 kB 00:00 2024-09-19T08:32:45.129 INFO:teuthology.orchestra.run.smithi150.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T08:32:45.131 INFO:teuthology.orchestra.run.smithi018.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 818 kB/s | 96 kB 00:00 2024-09-19T08:32:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 3.8 MB/s | 5.3 MB 00:01 2024-09-19T08:32:45.179 INFO:teuthology.orchestra.run.smithi150.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T08:32:45.190 INFO:teuthology.orchestra.run.smithi018.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2024-09-19T08:32:45.235 INFO:teuthology.orchestra.run.smithi162.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-19T08:32:45.240 INFO:teuthology.orchestra.run.smithi018.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-19T08:32:45.291 INFO:teuthology.orchestra.run.smithi018.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:32:45.317 INFO:teuthology.orchestra.run.smithi162.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 389 kB/s | 32 kB 00:00 2024-09-19T08:32:45.324 INFO:teuthology.orchestra.run.smithi018.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T08:32:45.349 INFO:teuthology.orchestra.run.smithi018.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-19T08:32:45.409 INFO:teuthology.orchestra.run.smithi162.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T08:32:45.483 INFO:teuthology.orchestra.run.smithi018.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-19T08:32:45.538 INFO:teuthology.orchestra.run.smithi018.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 479 kB/s | 26 kB 00:00 2024-09-19T08:32:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-19T08:32:45.601 INFO:teuthology.orchestra.run.smithi018.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 777 kB/s | 49 kB 00:00 2024-09-19T08:32:45.738 INFO:teuthology.orchestra.run.smithi150.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2024-09-19T08:32:45.768 INFO:teuthology.orchestra.run.smithi018.stdout:(111/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-19T08:32:45.802 INFO:teuthology.orchestra.run.smithi018.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 299 kB/s | 67 kB 00:00 2024-09-19T08:32:45.827 INFO:teuthology.orchestra.run.smithi018.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 695 kB/s | 151 kB 00:00 2024-09-19T08:32:45.852 INFO:teuthology.orchestra.run.smithi018.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:32:45.877 INFO:teuthology.orchestra.run.smithi018.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:32:45.911 INFO:teuthology.orchestra.run.smithi018.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-09-19T08:32:45.936 INFO:teuthology.orchestra.run.smithi018.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-19T08:32:45.961 INFO:teuthology.orchestra.run.smithi018.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-19T08:32:45.987 INFO:teuthology.orchestra.run.smithi018.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T08:32:46.012 INFO:teuthology.orchestra.run.smithi018.stdout:(120/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-09-19T08:32:46.037 INFO:teuthology.orchestra.run.smithi018.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-19T08:32:46.071 INFO:teuthology.orchestra.run.smithi018.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T08:32:46.096 INFO:teuthology.orchestra.run.smithi150.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 3.4 MB/s | 3.4 MB 00:00 2024-09-19T08:32:46.096 INFO:teuthology.orchestra.run.smithi018.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-19T08:32:46.117 INFO:teuthology.orchestra.run.smithi162.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 2.6 MB/s | 3.1 MB 00:01 2024-09-19T08:32:46.121 INFO:teuthology.orchestra.run.smithi018.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-19T08:32:46.147 INFO:teuthology.orchestra.run.smithi018.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-19T08:32:46.172 INFO:teuthology.orchestra.run.smithi150.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 543 kB/s | 41 kB 00:00 2024-09-19T08:32:46.172 INFO:teuthology.orchestra.run.smithi018.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-19T08:32:46.197 INFO:teuthology.orchestra.run.smithi018.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T08:32:46.222 INFO:teuthology.orchestra.run.smithi018.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-19T08:32:46.247 INFO:teuthology.orchestra.run.smithi150.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T08:32:46.256 INFO:teuthology.orchestra.run.smithi018.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T08:32:46.267 INFO:teuthology.orchestra.run.smithi162.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 4.2 MB/s | 3.6 MB 00:00 2024-09-19T08:32:46.290 INFO:teuthology.orchestra.run.smithi018.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T08:32:46.314 INFO:teuthology.orchestra.run.smithi150.stdout:(153/156): librbd1-19.1.1-361.g2f599a46.el9.x86 2.7 MB/s | 3.2 MB 00:01 2024-09-19T08:32:46.323 INFO:teuthology.orchestra.run.smithi018.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-19T08:32:46.348 INFO:teuthology.orchestra.run.smithi018.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 989 kB/s | 58 kB 00:00 2024-09-19T08:32:46.351 INFO:teuthology.orchestra.run.smithi162.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T08:32:46.364 INFO:teuthology.orchestra.run.smithi150.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 2.9 MB/s | 1.8 MB 00:00 2024-09-19T08:32:46.374 INFO:teuthology.orchestra.run.smithi018.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-19T08:32:46.399 INFO:teuthology.orchestra.run.smithi018.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T08:32:46.424 INFO:teuthology.orchestra.run.smithi018.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T08:32:46.426 INFO:teuthology.orchestra.run.smithi162.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 660 kB/s | 49 kB 00:00 2024-09-19T08:32:46.450 INFO:teuthology.orchestra.run.smithi018.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-19T08:32:46.481 INFO:teuthology.orchestra.run.smithi150.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-19T08:32:46.484 INFO:teuthology.orchestra.run.smithi018.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-09-19T08:32:46.501 INFO:teuthology.orchestra.run.smithi162.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T08:32:46.509 INFO:teuthology.orchestra.run.smithi018.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T08:32:46.551 INFO:teuthology.orchestra.run.smithi018.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-19T08:32:46.576 INFO:teuthology.orchestra.run.smithi018.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-09-19T08:32:46.585 INFO:teuthology.orchestra.run.smithi162.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.3 MB/s | 285 kB 00:00 2024-09-19T08:32:46.601 INFO:teuthology.orchestra.run.smithi018.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T08:32:46.626 INFO:teuthology.orchestra.run.smithi018.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T08:32:46.652 INFO:teuthology.orchestra.run.smithi018.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:32:46.677 INFO:teuthology.orchestra.run.smithi018.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-19T08:32:46.702 INFO:teuthology.orchestra.run.smithi018.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-19T08:32:46.728 INFO:teuthology.orchestra.run.smithi018.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:32:46.753 INFO:teuthology.orchestra.run.smithi018.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T08:32:46.794 INFO:teuthology.orchestra.run.smithi162.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 3.6 MB/s | 765 kB 00:00 2024-09-19T08:32:46.803 INFO:teuthology.orchestra.run.smithi018.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T08:32:46.861 INFO:teuthology.orchestra.run.smithi162.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 274 kB/s | 18 kB 00:00 2024-09-19T08:32:46.981 INFO:teuthology.orchestra.run.smithi150.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-19T08:32:46.989 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:32:46.989 INFO:teuthology.orchestra.run.smithi150.stdout:Total 12 MB/s | 226 MB 00:18 2024-09-19T08:32:47.503 INFO:teuthology.orchestra.run.smithi162.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 124 kB/s | 80 kB 00:00 2024-09-19T08:32:47.686 INFO:teuthology.orchestra.run.smithi018.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 3.6 MB/s | 3.4 MB 00:00 2024-09-19T08:32:47.728 INFO:teuthology.orchestra.run.smithi018.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2024-09-19T08:32:47.837 INFO:teuthology.orchestra.run.smithi018.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 377 kB/s | 41 kB 00:00 2024-09-19T08:32:47.921 INFO:teuthology.orchestra.run.smithi018.stdout:(152/156): librbd1-19.1.1-361.g2f599a46.el9.x86 2.7 MB/s | 3.2 MB 00:01 2024-09-19T08:32:47.954 INFO:teuthology.orchestra.run.smithi018.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-19T08:32:48.208 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-19T08:32:48.279 INFO:teuthology.orchestra.run.smithi018.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 2.4 MB 00:00 2024-09-19T08:32:48.359 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-19T08:32:48.359 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-19T08:32:48.461 INFO:teuthology.orchestra.run.smithi162.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 837 kB/s | 801 kB 00:00 2024-09-19T08:32:48.612 INFO:teuthology.orchestra.run.smithi162.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 3.0 MB/s | 7.4 MB 00:02 2024-09-19T08:32:48.746 INFO:teuthology.orchestra.run.smithi018.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 1.4 MB 00:00 2024-09-19T08:32:48.788 INFO:teuthology.orchestra.run.smithi018.stdout:(156/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-09-19T08:32:48.794 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:32:48.795 INFO:teuthology.orchestra.run.smithi018.stdout:Total 12 MB/s | 226 MB 00:19 2024-09-19T08:32:49.278 INFO:teuthology.orchestra.run.smithi162.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 234 kB/s | 191 kB 00:00 2024-09-19T08:32:49.379 INFO:teuthology.orchestra.run.smithi162.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-09-19T08:32:50.063 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T08:32:50.234 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T08:32:50.234 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T08:32:50.321 INFO:teuthology.orchestra.run.smithi162.stdout:(43/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 5.9 MB/s | 49 MB 00:08 2024-09-19T08:32:50.348 INFO:teuthology.orchestra.run.smithi162.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 110 kB/s | 106 kB 00:00 2024-09-19T08:32:50.569 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-19T08:32:50.569 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-19T08:32:50.873 INFO:teuthology.orchestra.run.smithi162.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 787 kB/s | 1.2 MB 00:01 2024-09-19T08:32:51.007 INFO:teuthology.orchestra.run.smithi162.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 197 kB/s | 135 kB 00:00 2024-09-19T08:32:51.040 INFO:teuthology.orchestra.run.smithi162.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 180 kB/s | 125 kB 00:00 2024-09-19T08:32:51.299 INFO:teuthology.orchestra.run.smithi162.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-19T08:32:51.367 INFO:teuthology.orchestra.run.smithi162.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-19T08:32:51.391 INFO:teuthology.orchestra.run.smithi162.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-19T08:32:51.425 INFO:teuthology.orchestra.run.smithi162.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-19T08:32:51.450 INFO:teuthology.orchestra.run.smithi162.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-19T08:32:51.476 INFO:teuthology.orchestra.run.smithi162.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-09-19T08:32:51.526 INFO:teuthology.orchestra.run.smithi162.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-09-19T08:32:51.576 INFO:teuthology.orchestra.run.smithi162.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T08:32:51.635 INFO:teuthology.orchestra.run.smithi162.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T08:32:51.677 INFO:teuthology.orchestra.run.smithi162.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T08:32:51.727 INFO:teuthology.orchestra.run.smithi162.stdout:(58/156): python3-urllib3-1.26.5-6.el9.noarch.r 252 kB/s | 215 kB 00:00 2024-09-19T08:32:51.769 INFO:teuthology.orchestra.run.smithi162.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-19T08:32:51.811 INFO:teuthology.orchestra.run.smithi162.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-19T08:32:51.861 INFO:teuthology.orchestra.run.smithi162.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T08:32:51.970 INFO:teuthology.orchestra.run.smithi162.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2024-09-19T08:32:52.029 INFO:teuthology.orchestra.run.smithi162.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-19T08:32:52.054 INFO:teuthology.orchestra.run.smithi162.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-09-19T08:32:52.087 INFO:teuthology.orchestra.run.smithi162.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-19T08:32:52.526 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T08:32:52.526 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T08:32:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-09-19T08:32:53.538 INFO:teuthology.orchestra.run.smithi162.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-09-19T08:32:53.813 INFO:teuthology.orchestra.run.smithi162.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-09-19T08:32:53.930 INFO:teuthology.orchestra.run.smithi162.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T08:32:54.056 INFO:teuthology.orchestra.run.smithi162.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 1.7 MB/s | 910 kB 00:00 2024-09-19T08:32:54.356 INFO:teuthology.orchestra.run.smithi162.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.1 MB/s | 4.9 MB 00:02 2024-09-19T08:32:54.445 INFO:teuthology.orchestra.run.smithi162.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 986 kB/s | 87 kB 00:00 2024-09-19T08:32:54.632 INFO:teuthology.orchestra.run.smithi162.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 8.2 MB/s | 5.8 MB 00:00 2024-09-19T08:32:54.732 INFO:teuthology.orchestra.run.smithi162.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 612 kB/s | 61 kB 00:00 2024-09-19T08:32:54.799 INFO:teuthology.orchestra.run.smithi162.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-19T08:32:54.858 INFO:teuthology.orchestra.run.smithi162.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T08:32:54.925 INFO:teuthology.orchestra.run.smithi162.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-19T08:32:54.983 INFO:teuthology.orchestra.run.smithi162.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-19T08:32:55.050 INFO:teuthology.orchestra.run.smithi162.stdout:(79/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-19T08:32:55.075 INFO:teuthology.orchestra.run.smithi162.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-19T08:32:55.093 INFO:teuthology.orchestra.run.smithi162.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 827 kB/s | 35 kB 00:00 2024-09-19T08:32:55.168 INFO:teuthology.orchestra.run.smithi162.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-19T08:32:55.235 INFO:teuthology.orchestra.run.smithi162.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-19T08:32:55.293 INFO:teuthology.orchestra.run.smithi162.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T08:32:55.344 INFO:teuthology.orchestra.run.smithi162.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-19T08:32:55.410 INFO:teuthology.orchestra.run.smithi162.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-19T08:32:55.436 INFO:teuthology.orchestra.run.smithi162.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-19T08:32:55.469 INFO:teuthology.orchestra.run.smithi162.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T08:32:55.495 INFO:teuthology.orchestra.run.smithi162.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T08:32:55.512 INFO:teuthology.orchestra.run.smithi162.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T08:32:55.537 INFO:teuthology.orchestra.run.smithi162.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-09-19T08:32:55.579 INFO:teuthology.orchestra.run.smithi162.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-19T08:32:55.629 INFO:teuthology.orchestra.run.smithi162.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-19T08:32:55.688 INFO:teuthology.orchestra.run.smithi162.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T08:32:55.739 INFO:teuthology.orchestra.run.smithi162.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-19T08:32:55.797 INFO:teuthology.orchestra.run.smithi162.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-19T08:32:55.881 INFO:teuthology.orchestra.run.smithi162.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-19T08:32:55.939 INFO:teuthology.orchestra.run.smithi162.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-19T08:32:55.998 INFO:teuthology.orchestra.run.smithi162.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-19T08:32:56.048 INFO:teuthology.orchestra.run.smithi162.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-19T08:32:56.099 INFO:teuthology.orchestra.run.smithi162.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-19T08:32:56.458 INFO:teuthology.orchestra.run.smithi162.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-19T08:32:56.483 INFO:teuthology.orchestra.run.smithi162.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 58 kB/s | 22 kB 00:00 2024-09-19T08:32:56.533 INFO:teuthology.orchestra.run.smithi162.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:32:56.567 INFO:teuthology.orchestra.run.smithi162.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T08:32:56.592 INFO:teuthology.orchestra.run.smithi162.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T08:32:56.726 INFO:teuthology.orchestra.run.smithi162.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-19T08:32:56.751 INFO:teuthology.orchestra.run.smithi162.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T08:32:56.776 INFO:teuthology.orchestra.run.smithi162.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T08:32:56.802 INFO:teuthology.orchestra.run.smithi162.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:32:56.827 INFO:teuthology.orchestra.run.smithi162.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T08:32:56.829 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-19T08:32:56.877 INFO:teuthology.orchestra.run.smithi162.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T08:32:56.919 INFO:teuthology.orchestra.run.smithi162.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T08:32:56.944 INFO:teuthology.orchestra.run.smithi162.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:32:56.960 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:32:56.969 INFO:teuthology.orchestra.run.smithi162.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:32:56.995 INFO:teuthology.orchestra.run.smithi162.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 559 kB/s | 14 kB 00:00 2024-09-19T08:32:57.021 INFO:teuthology.orchestra.run.smithi162.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-19T08:32:57.054 INFO:teuthology.orchestra.run.smithi162.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-19T08:32:57.062 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:32:57.088 INFO:teuthology.orchestra.run.smithi162.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T08:32:57.113 INFO:teuthology.orchestra.run.smithi162.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T08:32:57.147 INFO:teuthology.orchestra.run.smithi162.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-09-19T08:32:57.231 INFO:teuthology.orchestra.run.smithi162.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-09-19T08:32:57.256 INFO:teuthology.orchestra.run.smithi162.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-19T08:32:57.264 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:32:57.290 INFO:teuthology.orchestra.run.smithi162.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-09-19T08:32:57.307 INFO:teuthology.orchestra.run.smithi162.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T08:32:57.323 INFO:teuthology.orchestra.run.smithi162.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-09-19T08:32:57.341 INFO:teuthology.orchestra.run.smithi162.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-19T08:32:57.358 INFO:teuthology.orchestra.run.smithi162.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 582 kB/s | 20 kB 00:00 2024-09-19T08:32:57.379 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:32:57.383 INFO:teuthology.orchestra.run.smithi162.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:32:57.403 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:32:57.408 INFO:teuthology.orchestra.run.smithi162.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:32:57.442 INFO:teuthology.orchestra.run.smithi162.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-19T08:32:57.459 INFO:teuthology.orchestra.run.smithi162.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T08:32:57.460 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:32:57.484 INFO:teuthology.orchestra.run.smithi162.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-19T08:32:57.610 INFO:teuthology.orchestra.run.smithi162.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 109 kB/s | 16 kB 00:00 2024-09-19T08:32:57.677 INFO:teuthology.orchestra.run.smithi162.stdout:(135/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-09-19T08:32:57.702 INFO:teuthology.orchestra.run.smithi162.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-09-19T08:32:57.735 INFO:teuthology.orchestra.run.smithi162.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 358 kB/s | 90 kB 00:00 2024-09-19T08:32:57.761 INFO:teuthology.orchestra.run.smithi162.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.6 MB/s | 188 kB 00:00 2024-09-19T08:32:57.786 INFO:teuthology.orchestra.run.smithi162.stdout:(139/156): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-09-19T08:32:57.794 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:32:57.811 INFO:teuthology.orchestra.run.smithi162.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 801 kB/s | 59 kB 00:00 2024-09-19T08:32:57.837 INFO:teuthology.orchestra.run.smithi162.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-09-19T08:32:57.862 INFO:teuthology.orchestra.run.smithi162.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-19T08:32:57.887 INFO:teuthology.orchestra.run.smithi162.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:32:57.895 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:32:57.921 INFO:teuthology.orchestra.run.smithi162.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-19T08:32:57.946 INFO:teuthology.orchestra.run.smithi162.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-19T08:32:57.971 INFO:teuthology.orchestra.run.smithi162.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:32:58.005 INFO:teuthology.orchestra.run.smithi162.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T08:32:58.026 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:32:58.056 INFO:teuthology.orchestra.run.smithi162.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T08:32:58.063 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:32:58.154 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:32:58.193 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:32:58.369 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:32:58.432 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:32:58.459 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:32:58.571 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:32:58.593 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:32:58.656 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:32:58.678 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:32:58.696 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:32:58.747 INFO:teuthology.orchestra.run.smithi162.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 4.3 MB/s | 3.2 MB 00:00 2024-09-19T08:32:58.881 INFO:teuthology.orchestra.run.smithi162.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 3.8 MB/s | 3.4 MB 00:00 2024-09-19T08:32:58.916 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:32:59.097 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:32:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T08:32:59.209 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:32:59.231 INFO:teuthology.orchestra.run.smithi162.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-09-19T08:32:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:32:59.315 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:32:59.385 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:32:59.501 INFO:teuthology.orchestra.run.smithi162.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 66 kB/s | 41 kB 00:00 2024-09-19T08:32:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:32:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:32:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:32:59.620 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:59.730 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:32:59.782 INFO:teuthology.orchestra.run.smithi162.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-09-19T08:32:59.820 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:32:59.858 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:32:59.892 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:32:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:32:59.957 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:32:59.982 INFO:teuthology.orchestra.run.smithi162.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 332 kB/s | 249 kB 00:00 2024-09-19T08:33:00.026 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:33:00.058 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:33:00.061 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:00.102 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:33:00.135 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:33:00.170 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:33:00.185 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:00.239 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:33:00.292 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:33:00.304 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:00.324 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:33:00.333 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:00.367 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:33:00.444 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:33:00.449 INFO:teuthology.orchestra.run.smithi162.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-19T08:33:00.478 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:33:00.513 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:33:00.526 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:33:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:33:00.592 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:33:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:33:00.626 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:00.656 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:33:00.716 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:00.733 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:33:00.752 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:33:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:33:00.824 INFO:teuthology.orchestra.run.smithi162.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-19T08:33:00.831 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:33:00.831 INFO:teuthology.orchestra.run.smithi162.stdout:Total 7.2 MB/s | 226 MB 00:31 2024-09-19T08:33:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:33:00.863 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:33:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:33:00.925 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:33:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:33:01.448 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:33:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:33:01.529 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:33:01.558 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:33:01.602 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:33:01.602 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:33:01.639 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:33:01.681 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:33:01.734 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:01.820 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:01.829 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:33:01.875 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:33:01.930 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:33:02.002 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:33:02.035 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:33:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:02.070 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:33:02.081 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-19T08:33:02.125 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:33:02.170 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:33:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:33:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:33:02.234 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-19T08:33:02.235 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-19T08:33:02.255 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:33:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:33:02.309 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:33:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:33:02.391 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:33:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:33:02.432 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:33:02.473 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:33:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:33:02.518 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:33:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:33:02.576 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:33:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:33:02.608 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:33:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:33:02.648 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:33:02.681 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:33:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:33:02.706 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:33:02.767 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:33:02.796 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:33:02.804 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:33:02.828 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:33:02.907 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:33:02.927 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:33:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:33:02.985 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:33:02.995 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:33:03.005 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:33:03.019 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:33:03.037 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:33:03.084 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:33:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:33:03.107 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:33:03.137 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:33:03.150 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:33:03.172 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:33:03.205 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:33:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:33:03.247 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:33:03.281 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:33:03.359 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:33:03.382 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:33:03.411 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:33:03.443 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:33:03.446 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:33:03.545 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:33:03.602 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:33:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:33:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:33:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:33:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:33:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:33:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:33:04.313 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:33:04.357 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:33:04.391 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:33:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:33:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:33:04.468 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-19T08:33:04.468 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-19T08:33:04.488 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:33:04.518 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:33:04.563 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:33:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:33:04.607 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:33:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:33:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:33:04.697 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:33:04.713 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:33:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:33:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:33:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:33:04.834 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:33:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:33:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:33:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:33:05.046 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:33:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:33:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:33:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:33:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:33:05.309 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:33:05.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:33:05.366 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:33:05.459 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:33:05.591 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:33:05.632 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:33:05.661 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:33:05.690 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:33:05.695 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:33:05.734 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:33:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:33:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:33:05.806 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:33:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:33:05.872 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:33:05.913 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:33:05.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:33:06.038 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:33:06.087 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:33:06.118 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:33:06.231 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:33:06.289 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:33:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:33:07.072 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:33:07.103 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:33:07.136 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:33:07.179 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:33:07.215 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:33:07.241 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:33:07.248 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:33:07.301 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:33:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:33:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:33:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:33:07.558 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:33:07.603 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:07.665 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:33:07.694 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:07.695 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:33:07.724 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:33:07.761 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:33:07.784 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:33:08.241 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:33:08.272 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:08.344 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:08.374 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:33:08.498 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:33:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:33:10.045 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:33:10.126 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:33:10.154 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:33:10.187 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:33:10.514 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:33:10.562 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:33:10.692 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:10.707 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:33:10.754 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:10.803 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-19T08:33:10.894 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:33:10.933 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:33:10.996 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:33:11.037 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:33:11.067 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:33:11.121 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:33:11.216 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:33:11.245 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:11.300 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:11.325 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:11.341 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:11.355 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:33:11.434 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:11.435 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:33:11.435 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:33:11.435 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:11.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:33:11.466 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:11.577 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:11.699 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:11.728 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:11.829 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:11.879 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:12.070 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:33:12.122 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:33:12.149 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:12.246 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:12.275 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:33:12.339 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:33:12.368 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:33:12.401 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:33:12.576 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:33:12.756 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:33:12.909 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:33:13.033 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:13.110 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:13.361 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:13.485 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:33:13.586 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:33:13.637 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:33:13.676 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:33:13.728 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:13.741 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:33:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:13.785 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:33:13.817 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:33:13.869 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:33:13.910 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:33:13.938 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:33:14.006 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:33:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:33:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:33:14.135 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:33:14.210 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:33:14.254 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:33:14.297 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:33:14.334 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:33:14.359 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:14.398 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:14.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:33:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:33:14.478 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:14.478 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:33:14.478 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:33:14.478 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:14.524 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:14.531 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:33:14.665 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:33:14.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:33:15.254 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:33:15.348 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:33:15.377 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:33:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:33:15.466 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:33:15.517 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:33:15.678 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:33:15.744 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:33:15.799 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:33:15.871 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:33:15.904 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:33:15.940 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:33:15.995 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:33:16.039 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:33:16.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:33:16.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:33:16.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:33:16.310 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:33:16.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:33:16.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:33:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:33:16.558 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:33:16.592 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:33:16.617 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:33:16.710 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:33:16.835 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:33:16.866 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:33:16.899 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:33:16.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:33:16.968 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:33:17.008 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:33:17.038 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:33:17.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:33:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:33:17.150 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:33:17.194 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:33:17.281 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:33:17.325 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:33:17.355 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:33:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:33:17.523 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:33:18.264 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:33:18.321 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:33:18.357 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:33:18.464 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:33:18.518 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:33:18.571 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:33:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:33:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:33:18.895 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:33:18.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:33:19.010 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:33:19.674 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:33:19.793 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:33:21.054 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:33:21.141 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:33:21.169 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:33:21.205 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:33:21.510 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:33:21.590 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:21.923 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:22.012 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:33:22.055 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:33:22.549 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:33:22.585 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:22.657 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:22.686 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-09-19T08:33:23.111 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:23.296 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:23.314 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:23.314 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:23.314 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:33:23.314 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:24.775 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:24.802 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:24.802 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:24.802 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:33:24.802 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:24.802 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:24.802 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:24.938 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:24.975 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:25.025 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:25.049 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:25.049 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:25.049 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:33:25.049 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:25.049 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:25.049 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:25.485 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:25.509 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:25.509 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:25.509 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:33:25.509 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:25.509 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:25.509 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:25.533 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:25.578 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:25.614 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:33:25.671 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:25.672 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:33:25.672 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:33:25.672 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:25.672 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:33:25.713 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:25.726 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:33:25.911 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:33:25.985 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:33:26.062 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:33:26.151 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:33:26.282 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:33:26.344 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:33:26.375 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:33:26.403 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:33:26.848 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:26.877 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:26.908 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:33:26.970 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:33:27.000 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:27.226 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:27.226 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-19T08:33:27.227 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:27.411 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:27.429 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:27.429 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:27.429 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:33:27.429 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:28.045 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:28.085 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:28.994 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:28.995 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:33:28.995 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:28.995 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:29.257 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:29.257 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:33:29.257 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:29.258 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:33:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:29.386 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:29.386 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:33:29.387 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:29.387 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:33:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:33:29.716 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:29.741 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:29.741 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:33:29.741 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:29.741 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:29.855 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:33:29.921 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:33:29.994 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:33:30.189 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:33:30.234 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:33:30.316 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:33:30.412 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:33:30.523 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:33:30.552 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:30.567 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:33:30.576 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:30.576 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:30.577 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:33:30.577 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:30.577 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:30.577 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:30.613 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:33:30.624 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:30.648 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:30.648 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:30.648 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:33:30.648 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:30.658 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:33:30.694 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:33:30.700 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:30.724 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:30.724 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:30.724 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:33:30.724 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:30.724 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:30.724 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:31.031 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:31.050 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:31.050 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:33:31.050 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:31.050 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:31.059 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:31.091 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:33:31.190 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:32.297 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:32.334 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:33.346 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:33.376 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:33.485 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:33.654 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:33:33.686 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:33.712 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:33.712 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:33.712 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:33:33.712 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:33.712 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:33.712 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:33.762 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:33.775 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:33.876 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:33:33.937 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:33:34.913 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:33:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:34.974 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:34.974 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:33:34.974 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:34.974 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:35.015 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:35.040 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:35.040 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:35.040 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:33:35.040 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:35.091 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:35.116 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:35.116 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:33:35.116 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:35.116 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:35.433 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:35.458 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:35.458 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:35.459 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:33:35.459 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:35.459 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:35.459 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:35.587 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:33:35.629 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:33:35.669 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:33:35.702 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:33:35.729 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:33:35.924 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:33:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:33:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:33:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:33:36.073 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:33:36.697 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:36.738 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:36.758 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:37.482 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-19T08:33:37.482 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-19T08:33:37.482 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-19T08:33:37.482 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-19T08:33:37.482 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-19T08:33:37.483 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-19T08:33:37.483 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-19T08:33:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:37.591 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:33:37.655 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:37.671 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:37.671 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:37.671 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:33:37.671 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:37.684 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:33:37.735 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:33:37.831 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:33:37.862 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:33:37.888 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:33:37.930 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:33:37.931 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:38.006 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:38.006 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:38.090 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:38.115 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:33:38.120 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:38.121 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:38.300 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:38.301 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:39.175 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:39.202 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:39.202 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:39.202 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:33:39.202 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:39.202 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:39.202 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:39.426 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:39.449 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:39.449 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:39.449 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:33:39.450 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:39.450 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:39.450 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:39.885 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:39.908 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:39.908 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:39.908 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:33:39.908 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:39.909 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:39.909 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:40.015 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:33:40.127 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:33:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:33:40.322 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:33:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:33:40.369 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:33:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:33:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:33:40.437 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:33:40.447 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:33:40.535 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:33:40.656 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:33:40.674 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:33:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:33:40.727 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:33:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:33:40.759 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:33:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:33:40.787 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:33:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:33:41.200 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:41.228 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:41.262 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:33:41.322 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:33:41.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:41.438 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:41.479 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:41.501 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:42.404 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:33:42.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:33:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:33:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:33:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:33:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:33:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:33:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:33:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:43.398 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:43.428 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:43.531 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:43.692 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:33:43.722 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:43.746 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:33:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:43.746 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:43.747 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:43.806 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:43.818 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:43.916 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:33:43.966 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:33:44.231 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:44.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:44.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:33:44.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:33:44.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:33:44.235 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:33:44.236 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:33:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:33:44.238 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:33:44.239 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:33:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:33:44.241 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:33:44.242 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:33:44.243 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:33:44.244 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:33:44.245 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:33:44.886 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:33:44.925 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:44.949 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:44.950 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:44.950 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:33:44.950 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:44.950 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:44.950 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:44.993 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:45.016 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:45.016 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:45.016 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:33:45.016 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:45.068 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:45.092 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:33:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:45.092 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:45.394 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:45.418 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:45.418 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:45.418 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:33:45.418 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:45.418 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:45.418 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:33:46.694 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:46.694 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:46.694 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-09-19T08:33:46.694 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:46.694 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.695 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.696 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:33:46.697 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:33:46.698 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:33:46.699 INFO:teuthology.orchestra.run.smithi150.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:33:46.700 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.701 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:33:46.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:33:46.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:33:46.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:33:46.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:33:46.706 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:33:46.707 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-19T08:33:47.121 DEBUG:teuthology.parallel:result is None 2024-09-19T08:33:48.911 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:48.911 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:33:48.911 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:33:48.911 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:33:48.911 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:33:48.912 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:33:48.913 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:33:48.925 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:33:48.925 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:33:48.925 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:33:48.925 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:33:48.925 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:33:48.926 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:33:48.927 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:33:48.928 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:33:48.929 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:33:48.930 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:33:48.931 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:33:48.932 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:33:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:33:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:33:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:33:49.990 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:33:50.039 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:33:50.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:33:50.112 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:33:50.140 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:33:50.333 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:33:50.387 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:33:50.417 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:33:50.447 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:33:50.493 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:33:51.095 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:51.133 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:51.154 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:51.397 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T08:33:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:33:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:33:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:33:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:33:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:33:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:33:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:33:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:33:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:33:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:33:51.411 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T08:33:51.832 DEBUG:teuthology.parallel:result is None 2024-09-19T08:33:51.993 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:33:52.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:33:52.123 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:33:52.212 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:33:52.242 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:33:52.268 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:33:52.302 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:33:52.302 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:52.386 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:52.386 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:52.504 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:33:52.510 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:52.510 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:52.689 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:52.689 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:52.773 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:52.838 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:58.811 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:58.811 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:33:58.812 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:33:58.813 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:33:58.814 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:33:58.814 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:33:58.814 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:33:58.814 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:33:58.826 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:33:58.827 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:33:58.828 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:33:58.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:33:58.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:33:58.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:33:58.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:33:58.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:33:58.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:33:58.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:33:58.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:33:58.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:33:58.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:33:58.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:33:58.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:33:58.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.584 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.585 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.586 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:34:01.587 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:34:01.588 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:34:01.589 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:34:01.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:34:01.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:34:01.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:34:01.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:34:01.595 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:34:01.596 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:34:01.597 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:34:01.597 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:34:01.597 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-19T08:34:02.017 DEBUG:teuthology.parallel:result is None 2024-09-19T08:34:02.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:02.175 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:34:02.203 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:34:02.204 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:34:02.204 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:34:02.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:02.354 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:34:02.380 INFO:teuthology.orchestra.run.smithi150.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:34:02.380 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:34:02.380 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:34:02.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:02.520 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:34:02.543 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:34:02.544 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:34:02.544 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:34:02.545 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:34:02.546 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:34:02.546 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:34:02.579 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:34:02.580 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:34:02.612 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:34:02.612 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:34:02.639 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:34:02.640 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:34:02.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:34:02.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:34:02.741 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:34:02.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:34:02.771 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:34:02.839 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:34:02.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:34:02.865 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:34:02.931 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:34:02.931 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:34:02.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:34:02.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:34:03.032 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:34:03.032 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:34:03.058 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:34:03.124 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:34:03.124 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:34:03.149 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:34:03.215 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:34:03.215 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:34:03.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:34:03.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:34:03.308 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:34:03.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:34:03.334 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:34:03.400 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:34:03.400 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:34:03.426 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:34:03.491 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:34:03.592 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T08:34:03.593 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:03.593 INFO:tasks.cephadm:Cluster fsid is ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:34:03.593 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:34:03.594 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.18', 'mon.b': '172.21.15.150', 'mon.c': '172.21.15.162'} 2024-09-19T08:34:03.594 INFO:tasks.cephadm:First mon is mon.a on smithi018 2024-09-19T08:34:03.594 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:34:03.594 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:34:03.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-09-19T08:34:03.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname $(hostname -s) 2024-09-19T08:34:03.646 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-19T08:34:03.671 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:34:03.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:03.814 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:34:03.952 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:03.953 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:34:03.953 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:34:03.954 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:34 /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.658 DEBUG:teuthology.orchestra.run.smithi150:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.207 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:34 /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.208 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.766 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:34 /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.766 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.787 DEBUG:teuthology.orchestra.run.smithi150:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.806 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:05.841 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:34:05.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:34:05.844 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:34:05.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:34:07.505 INFO:teuthology.orchestra.run.smithi150.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:07.615 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:39.596 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-19T08:34:39.596 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:34:39.596 INFO:teuthology.orchestra.run.smithi150.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:34:39.596 INFO:teuthology.orchestra.run.smithi150.stdout: "repo_digests": [ 2024-09-19T08:34:39.596 INFO:teuthology.orchestra.run.smithi150.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:34:39.596 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-19T08:34:39.597 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:35:06.100 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:35:10.845 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T08:35:10.845 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:35:10.845 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:35:10.845 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-19T08:35:10.845 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:35:10.845 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-19T08:35:10.846 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T08:35:10.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-09-19T08:35:10.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph 2024-09-19T08:35:10.938 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-19T08:35:10.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-09-19T08:35:10.997 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /etc/ceph 2024-09-19T08:35:11.025 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-19T08:35:11.050 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:35:11.051 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:35:11.051 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:35:11.052 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:35:11.052 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:35:11.053 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:35:11.054 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:35:11.055 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:35:11.056 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T08:35:11.057 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:35:11.057 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:35:11.077 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ed3de594-7661-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:35:11.077 DEBUG:teuthology.orchestra.run.smithi018:mon.a> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:35:11.120 DEBUG:teuthology.orchestra.run.smithi018:mgr.x> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:35:11.163 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:35:11.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid ed3de594-7661-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.18 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:35:11.378 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:35:11.379 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'ed3de594-7661-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.18', '--skip-admin-label'] 2024-09-19T08:35:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:35:11.379 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying podman|docker is present... 2024-09-19T08:35:11.404 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:35:11.404 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying lvm2 is present... 2024-09-19T08:35:11.404 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying time synchronization is in place... 2024-09-19T08:35:11.412 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:35:11.412 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:35:11.419 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:35:11.419 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T08:35:11.426 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-19T08:35:11.433 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-19T08:35:11.433 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:35:11.433 INFO:teuthology.orchestra.run.smithi018.stdout:Repeating the final host check... 2024-09-19T08:35:11.455 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:35:11.455 INFO:teuthology.orchestra.run.smithi018.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:35:11.456 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl is present 2024-09-19T08:35:11.456 INFO:teuthology.orchestra.run.smithi018.stdout:lvcreate is present 2024-09-19T08:35:11.463 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:35:11.463 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:35:11.469 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:35:11.469 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T08:35:11.476 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-19T08:35:11.484 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-19T08:35:11.484 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:35:11.484 INFO:teuthology.orchestra.run.smithi018.stdout:Host looks OK 2024-09-19T08:35:11.484 INFO:teuthology.orchestra.run.smithi018.stdout:Cluster fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:11.484 INFO:teuthology.orchestra.run.smithi018.stdout:Acquiring lock 140079239635968 on /run/cephadm/ed3de594-7661-11ef-bceb-c7b262605968.lock 2024-09-19T08:35:11.484 INFO:teuthology.orchestra.run.smithi018.stdout:Lock 140079239635968 acquired on /run/cephadm/ed3de594-7661-11ef-bceb-c7b262605968.lock 2024-09-19T08:35:11.485 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 3300 ... 2024-09-19T08:35:11.485 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 6789 ... 2024-09-19T08:35:11.485 INFO:teuthology.orchestra.run.smithi018.stdout:Base mon IP(s) is [172.21.15.18:3300, 172.21.15.18:6789], mon addrv is [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-19T08:35:11.488 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.18 metric 100 2024-09-19T08:35:11.488 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.18 metric 100 2024-09-19T08:35:11.491 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:35:11.491 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T08:35:11.491 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-19T08:35:11.493 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:35:11.493 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:35:11.493 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:35:11.494 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T08:35:11.494 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T08:35:11.494 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:35:11.494 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-19T08:35:11.494 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-19T08:35:11.494 INFO:teuthology.orchestra.run.smithi018.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:35:11.495 INFO:teuthology.orchestra.run.smithi018.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:35:11.495 INFO:teuthology.orchestra.run.smithi018.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:35:14.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:35:21.213 INFO:teuthology.orchestra.run.smithi018.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:35:21.213 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:35:21.214 INFO:teuthology.orchestra.run.smithi018.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:35:22.427 INFO:teuthology.orchestra.run.smithi018.stdout:stat: stdout 167 167 2024-09-19T08:35:22.427 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial keys... 2024-09-19T08:35:23.315 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQBK4utme05jKxAAhBOtbWosdnCGI7qpV9mZQQ== 2024-09-19T08:35:24.204 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQBL4utmBW9JJxAAQBsU3ggJU0oVkSEGSjbLUg== 2024-09-19T08:35:25.159 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQBM4utmfFqgHhAAC8YweettaCZ0veVGXujn3Q== 2024-09-19T08:35:25.159 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial monmap... 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool for a [v2:172.21.15.18:3300,v1:172.21.15.18:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: set fsid to ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:26.241 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:35:26.241 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:35:26.241 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mon... 2024-09-19T08:35:29.211 INFO:teuthology.orchestra.run.smithi018.stdout:create mon.a on 2024-09-19T08:35:29.406 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:35:29.660 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:35:29.859 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ed3de594-7661-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ed3de594-7661-11ef-bceb-c7b262605968.target. 2024-09-19T08:35:29.859 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ed3de594-7661-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ed3de594-7661-11ef-bceb-c7b262605968.target. 2024-09-19T08:35:30.118 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:35:30.118 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:35:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ed3de594-7661-11ef-bceb-c7b262605968.target.wants/ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-ed3de594-7661-11ef-bceb-c7b262605968@.service. 2024-09-19T08:35:30.828 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:35:30.828 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T08:35:30.835 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:35:30.835 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T08:35:30.836 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T08:35:30.836 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:35:30.836 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon to start... 2024-09-19T08:35:30.836 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon... 2024-09-19T08:35:31.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:31 smithi018 ceph-mon[30591]: from='client.? 172.21.15.18:0/2293501417' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout id: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.528728s) 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:35:31.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.228+0000 7f2e7b7a8640 1 Processor -- start 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.228+0000 7f2e7b7a8640 1 -- start start 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.228+0000 7f2e7b7a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e74107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.228+0000 7f2e7b7a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e74107d50 con 0x7f2e74107380 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.229+0000 7f2e79544640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e74107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.229+0000 7f2e79544640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e74107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36842/0 (socket says 172.21.15.18:36842) 2024-09-19T08:35:31.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.229+0000 7f2e79544640 1 -- 172.21.15.18:0/3785506910 learned_addr learned my addr 172.21.15.18:0/3785506910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.229+0000 7f2e79544640 1 -- 172.21.15.18:0/3785506910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e74108580 con 0x7f2e74107380 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.231+0000 7f2e79544640 1 --2- 172.21.15.18:0/3785506910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e74107780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009820 tx=0x7f2e7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304e888fa6959cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.231+0000 7f2e6bfff640 1 -- 172.21.15.18:0/3785506910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e70037070 con 0x7f2e74107380 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.231+0000 7f2e6bfff640 1 -- 172.21.15.18:0/3785506910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e70032440 con 0x7f2e74107380 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.231+0000 7f2e6bfff640 1 -- 172.21.15.18:0/3785506910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e70032740 con 0x7f2e74107380 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/3785506910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 msgr2=0x7f2e74107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 --2- 172.21.15.18:0/3785506910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e74107780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009820 tx=0x7f2e7002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:31.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/3785506910 shutdown_connections 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 --2- 172.21.15.18:0/3785506910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e74107780 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/3785506910 >> 172.21.15.18:0/3785506910 conn(0x7f2e74102b10 msgr2=0x7f2e74104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/3785506910 shutdown_connections 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.232+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/3785506910 wait complete. 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e7b7a8640 1 Processor -- start 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e7b7a8640 1 -- start start 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e7b7a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e7419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e7b7a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e74108b20 con 0x7f2e74107380 2024-09-19T08:35:31.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e79544640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e7419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e79544640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e7419ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36844/0 (socket says 172.21.15.18:36844) 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e79544640 1 -- 172.21.15.18:0/2293501417 learned_addr learned my addr 172.21.15.18:0/2293501417 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.233+0000 7f2e79544640 1 -- 172.21.15.18:0/2293501417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7419b320 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e79544640 1 --2- 172.21.15.18:0/2293501417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e7419ade0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2e700090b0 tx=0x7f2e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e70041070 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7003c7a0 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e70037040 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7419b5b0 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7419e2a0 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e70044070 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.234+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e7003d3f0 con 0x7f2e74107380 2024-09-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.235+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e74109170 con 0x7f2e74107380 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.237+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e70046450 con 0x7f2e74107380 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.298+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2e74068690 con 0x7f2e74107380 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.299+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/2293501417 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f2e70046630 con 0x7f2e74107380 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 msgr2=0x7f2e7419ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 --2- 172.21.15.18:0/2293501417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e7419ade0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2e700090b0 tx=0x7f2e700046c0 comp rx=0 tx=0).stop 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 shutdown_connections 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 --2- 172.21.15.18:0/2293501417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e74107380 0x7f2e7419ade0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 >> 172.21.15.18:0/2293501417 conn(0x7f2e74102b10 msgr2=0x7f2e74191870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 shutdown_connections 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.300+0000 7f2e7b7a8640 1 -- 172.21.15.18:0/2293501417 wait complete. 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:mon is available 2024-09-19T08:35:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:35:32.894 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.286+0000 7f9f990c8640 1 Processor -- start 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.286+0000 7f9f990c8640 1 -- start start 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.286+0000 7f9f990c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94105aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.286+0000 7f9f990c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94106070 con 0x7f9f941056a0 2024-09-19T08:35:32.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.287+0000 7f9f92d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94105aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.287+0000 7f9f92d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94105aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36848/0 (socket says 172.21.15.18:36848) 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.287+0000 7f9f92d9d640 1 -- 172.21.15.18:0/3749482841 learned_addr learned my addr 172.21.15.18:0/3749482841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.287+0000 7f9f92d9d640 1 -- 172.21.15.18:0/3749482841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f941061f0 con 0x7f9f941056a0 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f92d9d640 1 --2- 172.21.15.18:0/3749482841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94105aa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009820 tx=0x7f9f8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e460207f3490bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f91d9b640 1 -- 172.21.15.18:0/3749482841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f84037070 con 0x7f9f941056a0 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f91d9b640 1 -- 172.21.15.18:0/3749482841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f84032440 con 0x7f9f941056a0 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f91d9b640 1 -- 172.21.15.18:0/3749482841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f84032740 con 0x7f9f941056a0 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 -- 172.21.15.18:0/3749482841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 msgr2=0x7f9f94105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 --2- 172.21.15.18:0/3749482841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94105aa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009820 tx=0x7f9f8402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 -- 172.21.15.18:0/3749482841 shutdown_connections 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 --2- 172.21.15.18:0/3749482841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94105aa0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:32.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 -- 172.21.15.18:0/3749482841 >> 172.21.15.18:0/3749482841 conn(0x7f9f94101190 msgr2=0x7f9f94103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:32.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 -- 172.21.15.18:0/3749482841 shutdown_connections 2024-09-19T08:35:32.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.288+0000 7f9f990c8640 1 -- 172.21.15.18:0/3749482841 wait complete. 2024-09-19T08:35:32.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.289+0000 7f9f990c8640 1 Processor -- start 2024-09-19T08:35:32.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.289+0000 7f9f990c8640 1 -- start start 2024-09-19T08:35:32.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.289+0000 7f9f990c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:32.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.289+0000 7f9f990c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94108a20 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f92d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f92d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36850/0 (socket says 172.21.15.18:36850) 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f92d9d640 1 -- 172.21.15.18:0/3875077791 learned_addr learned my addr 172.21.15.18:0/3875077791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f92d9d640 1 -- 172.21.15.18:0/3875077791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f941084e0 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f92d9d640 1 --2- 172.21.15.18:0/3875077791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94107fa0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9f840090b0 tx=0x7f9f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f84041070 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8403c7a0 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f941066d0 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f84037040 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.290+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f94106c10 con 0x7f9f941056a0 2024-09-19T08:35:32.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.291+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9f84044070 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.291+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9f84046dc0 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.291+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f94105b20 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.294+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9f84046450 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.354+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9f94194140 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.357+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f9f8403caa0 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.357+0000 7f9f7bfff640 1 -- 172.21.15.18:0/3875077791 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9f84032440 con 0x7f9f941056a0 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 msgr2=0x7f9f94107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 --2- 172.21.15.18:0/3875077791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94107fa0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9f840090b0 tx=0x7f9f840046c0 comp rx=0 tx=0).stop 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 shutdown_connections 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 --2- 172.21.15.18:0/3875077791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f941056a0 0x7f9f94107fa0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 >> 172.21.15.18:0/3875077791 conn(0x7f9f94101190 msgr2=0x7f9f941917d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 shutdown_connections 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.358+0000 7f9f990c8640 1 -- 172.21.15.18:0/3875077791 wait complete. 2024-09-19T08:35:32.899 INFO:teuthology.orchestra.run.smithi018.stdout:Generating new minimal ceph.conf... 2024-09-19T08:35:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:32 smithi018 ceph-mon[30591]: from='client.? 172.21.15.18:0/3875077791' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:35:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:32 smithi018 ceph-mon[30591]: from='client.? 172.21.15.18:0/3875077791' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:35:34.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:33 smithi018 ceph-mon[30591]: from='client.? 172.21.15.18:0/1494003361' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:35:34.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a202d3640 1 Processor -- start 2024-09-19T08:35:34.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a202d3640 1 -- start start 2024-09-19T08:35:34.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a202d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a202d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1807c870 con 0x7f5a1807de40 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a1e06f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a1e06f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36862/0 (socket says 172.21.15.18:36862) 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.290+0000 7f5a1e06f640 1 -- 172.21.15.18:0/483182266 learned_addr learned my addr 172.21.15.18:0/483182266 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.291+0000 7f5a1e06f640 1 -- 172.21.15.18:0/483182266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1807c9f0 con 0x7f5a1807de40 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.291+0000 7f5a1e06f640 1 --2- 172.21.15.18:0/483182266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1807c2a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009820 tx=0x7f5a1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ad28e97ffdf9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a1d06d640 1 -- 172.21.15.18:0/483182266 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a14037070 con 0x7f5a1807de40 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a1d06d640 1 -- 172.21.15.18:0/483182266 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a140328d0 con 0x7f5a1807de40 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a1d06d640 1 -- 172.21.15.18:0/483182266 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a140307d0 con 0x7f5a1807de40 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 -- 172.21.15.18:0/483182266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 msgr2=0x7f5a1807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 --2- 172.21.15.18:0/483182266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1807c2a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009820 tx=0x7f5a1402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 -- 172.21.15.18:0/483182266 shutdown_connections 2024-09-19T08:35:34.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 --2- 172.21.15.18:0/483182266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1807c2a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 -- 172.21.15.18:0/483182266 >> 172.21.15.18:0/483182266 conn(0x7f5a18102b10 msgr2=0x7f5a18104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 -- 172.21.15.18:0/483182266 shutdown_connections 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.292+0000 7f5a202d3640 1 -- 172.21.15.18:0/483182266 wait complete. 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a202d3640 1 Processor -- start 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a202d3640 1 -- start start 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a202d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1819d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a202d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1810d990 con 0x7f5a1807de40 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a1e06f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1819d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a1e06f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1819d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36864/0 (socket says 172.21.15.18:36864) 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a1e06f640 1 -- 172.21.15.18:0/1494003361 learned_addr learned my addr 172.21.15.18:0/1494003361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.293+0000 7f5a1e06f640 1 -- 172.21.15.18:0/1494003361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1819dd60 con 0x7f5a1807de40 2024-09-19T08:35:34.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a1e06f640 1 --2- 172.21.15.18:0/1494003361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1819d820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5a140097f0 tx=0x7f5a14030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a14037040 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a14032bb0 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1819dff0 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1403a390 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a181a0ce0 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a1403a580 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.294+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5a14044ba0 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.295+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1807c320 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.297+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5a14044400 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.357+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5a18068650 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.358+0000 7f5a0f7fe640 1 -- 172.21.15.18:0/1494003361 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f5a14032d60 con 0x7f5a1807de40 2024-09-19T08:35:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.358+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 msgr2=0x7f5a1819d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.358+0000 7f5a202d3640 1 --2- 172.21.15.18:0/1494003361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1819d820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5a140097f0 tx=0x7f5a14030d00 comp rx=0 tx=0).stop 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.359+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 shutdown_connections 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.359+0000 7f5a202d3640 1 --2- 172.21.15.18:0/1494003361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a1807de40 0x7f5a1819d820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.359+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 >> 172.21.15.18:0/1494003361 conn(0x7f5a18102b10 msgr2=0x7f5a181037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.359+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 shutdown_connections 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.359+0000 7f5a202d3640 1 -- 172.21.15.18:0/1494003361 wait complete. 2024-09-19T08:35:34.295 INFO:teuthology.orchestra.run.smithi018.stdout:Restarting the monitor... 2024-09-19T08:35:34.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:34 smithi018 systemd[1]: Stopping Ceph mon.a for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:35:34.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a[30587]: 2024-09-19T08:35:34.553+0000 7fd5b98c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:35:34.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a[30587]: 2024-09-19T08:35:34.553+0000 7fd5b98c9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:35:34.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:34 smithi018 podman[30834]: 2024-09-19 08:35:34.574385803 +0000 UTC m=+0.113391132 container died 98b76711648155aa8c805bd5ac681628cff121f7b368dbba79b41609b0de16ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:35:35.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:34 smithi018 podman[30834]: 2024-09-19 08:35:34.911218608 +0000 UTC m=+0.450223935 container cleanup 98b76711648155aa8c805bd5ac681628cff121f7b368dbba79b41609b0de16ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T08:35:35.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:34 smithi018 bash[30834]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:35:35.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 podman[30845]: 2024-09-19 08:35:35.103992845 +0000 UTC m=+0.526544719 container remove 98b76711648155aa8c805bd5ac681628cff121f7b368dbba79b41609b0de16ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:35:35.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:35:35.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 systemd[1]: Stopped Ceph mon.a for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:35:35.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 systemd[1]: Starting Ceph mon.a for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:35:35.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 podman[30936]: 2024-09-19 08:35:35.422601169 +0000 UTC m=+0.016588926 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:35:35.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 podman[30936]: 2024-09-19 08:35:35.555150316 +0000 UTC m=+0.149138100 container create d701052a226b12601f3bbdfe793ba2d4c5ccd0373325a599cc6e63842b4a35f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:35:35.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 podman[30936]: 2024-09-19 08:35:35.765747634 +0000 UTC m=+0.359735377 container init d701052a226b12601f3bbdfe793ba2d4c5ccd0373325a599cc6e63842b4a35f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:35:35.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 podman[30936]: 2024-09-19 08:35:35.768900313 +0000 UTC m=+0.362888064 container start d701052a226b12601f3bbdfe793ba2d4c5ccd0373325a599cc6e63842b4a35f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:35:35.852 INFO:teuthology.orchestra.run.smithi018.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:35:36.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: pidfile_write: ignore empty --pid-file 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: load: jerasure load: lrc 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Git sha 0 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: DB SUMMARY 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: DB Session ID: 27V7X93SJIL1QMZVJU9F 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:35:36.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103694 ; 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.env: 0x55e418077940 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.info_log: 0x55e418ae56e0 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.statistics: (nil) 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.use_fsync: 0 2024-09-19T08:35:36.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.db_log_dir: 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.wal_dir: 2024-09-19T08:35:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.write_buffer_manager: 0x55e418af4dc0 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:35:36.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.unordered_write: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.row_cache: None 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.wal_filter: None 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:35:36.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.wal_compression: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:35:36.200 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_open_files: -1 2024-09-19T08:35:36.202 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Compression algorithms supported: 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kZSTD supported: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:35:36.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.merge_operator: 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_filter: None 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e418ae5320) 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:35:36.204 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_type: 0 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_index_type: 0 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_shortening: 1 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: checksum: 4 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: no_block_cache: 0 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache: 0x55e418ad91f0 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_options: 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: capacity : 536870912 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_shard_bits : 4 2024-09-19T08:35:36.205 INFO:journalctl@ceph.mon.a.smithi018.stdout: strict_capacity_limit : 0 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_compressed: (nil) 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: persistent_cache: (nil) 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size: 4096 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size_deviation: 10 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_restart_interval: 16 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_block_restart_interval: 1 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: metadata_block_size: 4096 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: partition_filters: 0 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: use_delta_encoding: 1 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: filter_policy: bloomfilter 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: whole_key_filtering: 1 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: verify_compression: 0 2024-09-19T08:35:36.206 INFO:journalctl@ceph.mon.a.smithi018.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: format_version: 5 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_index_compression: 1 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_align: 0 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: max_auto_readahead_size: 262144 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: prepopulate_block_cache: 0 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression: NoCompression 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.num_levels: 7 2024-09-19T08:35:36.207 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:35:36.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:35:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:35:36.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:35:36.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.ttl: 2592000 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:35:36.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 717e4dfc-a1d5-4aaf-a970-9c260887e5b0 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726734935796309, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:35:36.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726734935797291, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 98889, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 96860, "index_size": 285, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13913, "raw_average_key_size": 49, "raw_value_size": 89266, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726734935, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "717e4dfc-a1d5-4aaf-a970-9c260887e5b0", "db_session_id": "27V7X93SJIL1QMZVJU9F", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726734935797389, "job": 1, "event": "recovery_finished"} 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e418b06e00 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: DB pointer 0x55e418c02000 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** DB Stats ** 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:35:36.214 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: L0 2/0 98.43 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: Sum 2/0 98.43 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:35:36.215 INFO:journalctl@ceph.mon.a.smithi018.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative compaction: 0.00 GB write, 29.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval compaction: 0.00 GB write, 29.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache BinnedLRUCache@0x55e418ad91f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: starting mon.a rank 0 at public addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] at bind addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???) e1 preinit fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).mds e1 new map 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: e1 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: btime 2024-09-19T08:35:30:772232+0000 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: legacy client fscid: -1 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout: No filesystems configured 2024-09-19T08:35:36.217 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 bash[30936]: d701052a226b12601f3bbdfe793ba2d4c5ccd0373325a599cc6e63842b4a35f8 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 systemd[1]: Started Ceph mon.a for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: monmap epoch 1 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: last_changed 2024-09-19T08:35:25.490759+0000 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: created 2024-09-19T08:35:25.490759+0000 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T08:35:36.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T08:35:36.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: fsmap 2024-09-19T08:35:36.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:35:36.219 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:35 smithi018 ceph-mon[30956]: mgrmap e1: no daemons active 2024-09-19T08:35:37.037 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.403+0000 7f708fd48640 1 Processor -- start 2024-09-19T08:35:37.037 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.404+0000 7f708fd48640 1 -- start start 2024-09-19T08:35:37.037 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.404+0000 7f708fd48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f7088107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:37.037 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.404+0000 7f708fd48640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7088107d50 con 0x7f7088107380 2024-09-19T08:35:37.037 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.404+0000 7f708dae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f7088107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:37.037 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.404+0000 7f708dae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f7088107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36872/0 (socket says 172.21.15.18:36872) 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.404+0000 7f708dae4640 1 -- 172.21.15.18:0/1313142993 learned_addr learned my addr 172.21.15.18:0/1313142993 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.405+0000 7f708dae4640 1 -- 172.21.15.18:0/1313142993 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7088108580 con 0x7f7088107380 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.406+0000 7f708dae4640 1 --2- 172.21.15.18:0/1313142993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f7088107780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7084009820 tx=0x7f708402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261c71a412606fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708cae2640 1 -- 172.21.15.18:0/1313142993 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7084037070 con 0x7f7088107380 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708cae2640 1 -- 172.21.15.18:0/1313142993 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f70840328d0 con 0x7f7088107380 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708cae2640 1 -- 172.21.15.18:0/1313142993 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70840307d0 con 0x7f7088107380 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 -- 172.21.15.18:0/1313142993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 msgr2=0x7f7088107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 --2- 172.21.15.18:0/1313142993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f7088107780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7084009820 tx=0x7f708402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:37.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 -- 172.21.15.18:0/1313142993 shutdown_connections 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 --2- 172.21.15.18:0/1313142993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f7088107780 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 -- 172.21.15.18:0/1313142993 >> 172.21.15.18:0/1313142993 conn(0x7f7088102b10 msgr2=0x7f7088104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 -- 172.21.15.18:0/1313142993 shutdown_connections 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.407+0000 7f708fd48640 1 -- 172.21.15.18:0/1313142993 wait complete. 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708fd48640 1 Processor -- start 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708fd48640 1 -- start start 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708fd48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f708819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708fd48640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f708810b930 con 0x7f7088107380 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708dae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f708819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:37.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708dae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f708819b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36878/0 (socket says 172.21.15.18:36878) 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.408+0000 7f708dae4640 1 -- 172.21.15.18:0/3726830645 learned_addr learned my addr 172.21.15.18:0/3726830645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f708dae4640 1 -- 172.21.15.18:0/3726830645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708819baf0 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f708dae4640 1 --2- 172.21.15.18:0/3726830645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f708819b5b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f70840097f0 tx=0x7f7084030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7084037040 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7084032bb0 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708819bd80 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708403a390 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708819ea70 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f708403a5d0 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.409+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7084044ba0 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.410+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708810bab0 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.413+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7084044400 con 0x7f7088107380 2024-09-19T08:35:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.472+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f7088107800 con 0x7f7088107380 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.473+0000 7f707effd640 1 -- 172.21.15.18:0/3726830645 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f7084044da0 con 0x7f7088107380 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 msgr2=0x7f708819b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 --2- 172.21.15.18:0/3726830645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f708819b5b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f70840097f0 tx=0x7f7084030d00 comp rx=0 tx=0).stop 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 shutdown_connections 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 --2- 172.21.15.18:0/3726830645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7088107380 0x7f708819b5b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 >> 172.21.15.18:0/3726830645 conn(0x7f7088102b10 msgr2=0x7f7088103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 shutdown_connections 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.474+0000 7f708fd48640 1 -- 172.21.15.18:0/3726830645 wait complete. 2024-09-19T08:35:37.041 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:35:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:35:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mgr... 2024-09-19T08:35:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:35:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:35:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:35:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:35:37.482 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ed3de594-7661-11ef-bceb-c7b262605968.target.wants/ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-ed3de594-7661-11ef-bceb-c7b262605968@.service. 2024-09-19T08:35:37.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:37 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3726830645' entity='client.admin' 2024-09-19T08:35:38.024 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:35:38.025 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T08:35:38.032 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:35:38.032 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T08:35:38.032 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T08:35:38.032 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:35:38.042 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:35:38.042 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T08:35:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:35:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T08:35:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T08:35:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:35:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr to start... 2024-09-19T08:35:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr... 2024-09-19T08:35:38.175 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:38.114+0000 7fe8bb7d5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:38.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:38.272+0000 7fe8bb7d5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:35:38.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:38.346+0000 7fe8bb7d5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:35:38.815 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2699572837' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:35:38.815 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:38.506+0000 7fe8bb7d5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:38.815 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:38.658+0000 7fe8bb7d5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:35:39.106 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:38.998+0000 7fe8bb7d5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:35:39.107 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:39.062+0000 7fe8bb7d5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "ed3de594-7661-11ef-bceb-c7b262605968", 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:35:39.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:35:39.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:35:39.114 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:35:39.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:35:30:772232+0000", 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:35:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:35:30.772923+0000", 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:39.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e6fad640 1 Processor -- start 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e6fad640 1 -- start start 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e6fad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e010a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e6fad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f26e00757a0 con 0x7f26e0107dc0 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e4d49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e010a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e4d49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e010a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36906/0 (socket says 172.21.15.18:36906) 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.451+0000 7f26e4d49640 1 -- 172.21.15.18:0/1468815535 learned_addr learned my addr 172.21.15.18:0/1468815535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.452+0000 7f26e4d49640 1 -- 172.21.15.18:0/1468815535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e010a6f0 con 0x7f26e0107dc0 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.452+0000 7f26e4d49640 1 --2- 172.21.15.18:0/1468815535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e010a1b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009820 tx=0x7f26c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f30a64cc92b547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.452+0000 7f26df7fe640 1 -- 172.21.15.18:0/1468815535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26c8037070 con 0x7f26e0107dc0 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26df7fe640 1 -- 172.21.15.18:0/1468815535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f26c80328d0 con 0x7f26e0107dc0 2024-09-19T08:35:39.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26df7fe640 1 -- 172.21.15.18:0/1468815535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26c80307d0 con 0x7f26e0107dc0 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 -- 172.21.15.18:0/1468815535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 msgr2=0x7f26e010a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 --2- 172.21.15.18:0/1468815535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e010a1b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009820 tx=0x7f26c802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 -- 172.21.15.18:0/1468815535 shutdown_connections 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 --2- 172.21.15.18:0/1468815535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e010a1b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 -- 172.21.15.18:0/1468815535 >> 172.21.15.18:0/1468815535 conn(0x7f26e01019a0 msgr2=0x7f26e0103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 -- 172.21.15.18:0/1468815535 shutdown_connections 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.453+0000 7f26e6fad640 1 -- 172.21.15.18:0/1468815535 wait complete. 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.454+0000 7f26e6fad640 1 Processor -- start 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.454+0000 7f26e6fad640 1 -- start start 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e6fad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e6fad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010b730 con 0x7f26e0107dc0 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e4d49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e4d49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36912/0 (socket says 172.21.15.18:36912) 2024-09-19T08:35:39.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e4d49640 1 -- 172.21.15.18:0/2699572837 learned_addr learned my addr 172.21.15.18:0/2699572837 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e4d49640 1 -- 172.21.15.18:0/2699572837 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e019bb00 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e4d49640 1 --2- 172.21.15.18:0/2699572837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e019b5c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26c80097f0 tx=0x7f26c8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26c8037040 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f26c8032bb0 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e019bd90 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26c803a390 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.455+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e019ea80 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.456+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f26c803a580 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.456+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f26c8044ba0 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.456+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0108220 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.459+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f26c8044400 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.521+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f26e002d7c0 con 0x7f26e0107dc0 2024-09-19T08:35:39.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.521+0000 7f26ddffb640 1 -- 172.21.15.18:0/2699572837 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f26c8032d60 con 0x7f26e0107dc0 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.522+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 msgr2=0x7f26e019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.522+0000 7f26e6fad640 1 --2- 172.21.15.18:0/2699572837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e019b5c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26c80097f0 tx=0x7f26c8030d00 comp rx=0 tx=0).stop 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.522+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 shutdown_connections 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.522+0000 7f26e6fad640 1 --2- 172.21.15.18:0/2699572837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0107dc0 0x7f26e019b5c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.522+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 >> 172.21.15.18:0/2699572837 conn(0x7f26e01019a0 msgr2=0x7f26e01026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.522+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 shutdown_connections 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.523+0000 7f26e6fad640 1 -- 172.21.15.18:0/2699572837 wait complete. 2024-09-19T08:35:39.128 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:35:39.443 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:39.258+0000 7fe8bb7d5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:35:40.443 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:40.186+0000 7fe8bb7d5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:35:40.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:40.256+0000 7fe8bb7d5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:35:41.293 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.020+0000 7fe8bb7d5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:35:41.293 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.143+0000 7fe8bb7d5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:35:41.580 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.293+0000 7fe8bb7d5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:41.580 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.358+0000 7fe8bb7d5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:35:41.580 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.517+0000 7fe8bb7d5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:35:41.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3736606720' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:35:41.832 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.593+0000 7fe8bb7d5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:35:41.832 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.658+0000 7fe8bb7d5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:35:41.832 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.832+0000 7fe8bb7d5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:35:42.120 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.901+0000 7fe8bb7d5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:35:42.120 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:41.971+0000 7fe8bb7d5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:35:42.120 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:42.058+0000 7fe8bb7d5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:42.120 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:42.120+0000 7fe8bb7d5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:35:42.243 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:42.243 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:42.243 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "ed3de594-7661-11ef-bceb-c7b262605968", 2024-09-19T08:35:42.243 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:42.244 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:35:42.245 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:35:42.253 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:35:30:772232+0000", 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:35:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:35:30.772923+0000", 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:35:42.255 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.580+0000 7fcf80bb1640 1 Processor -- start 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.580+0000 7fcf80bb1640 1 -- start start 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.580+0000 7fcf80bb1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c106650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.581+0000 7fcf80bb1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c106c20 con 0x7fcf7c106250 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.581+0000 7fcf7a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.581+0000 7fcf7a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c106650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41816/0 (socket says 172.21.15.18:41816) 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.581+0000 7fcf7a59c640 1 -- 172.21.15.18:0/3001783874 learned_addr learned my addr 172.21.15.18:0/3001783874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.581+0000 7fcf7a59c640 1 -- 172.21.15.18:0/3001783874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7c107450 con 0x7fcf7c106250 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.582+0000 7fcf7a59c640 1 --2- 172.21.15.18:0/3001783874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c106650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009820 tx=0x7fcf6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db1822f6aee5057 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.582+0000 7fcf79d9b640 1 -- 172.21.15.18:0/3001783874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf6c037070 con 0x7fcf7c106250 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.582+0000 7fcf79d9b640 1 -- 172.21.15.18:0/3001783874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcf6c0328d0 con 0x7fcf7c106250 2024-09-19T08:35:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.582+0000 7fcf79d9b640 1 -- 172.21.15.18:0/3001783874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf6c0307d0 con 0x7fcf7c106250 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3001783874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 msgr2=0x7fcf7c106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 --2- 172.21.15.18:0/3001783874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c106650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009820 tx=0x7fcf6c02a270 comp rx=0 tx=0).stop 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3001783874 shutdown_connections 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 --2- 172.21.15.18:0/3001783874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c106650 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3001783874 >> 172.21.15.18:0/3001783874 conn(0x7fcf7c1019a0 msgr2=0x7fcf7c103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3001783874 shutdown_connections 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3001783874 wait complete. 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 Processor -- start 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.583+0000 7fcf80bb1640 1 -- start start 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf80bb1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf80bb1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c10a800 con 0x7fcf7c106250 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf7a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf7a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c19d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41830/0 (socket says 172.21.15.18:41830) 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf7a59c640 1 -- 172.21.15.18:0/3736606720 learned_addr learned my addr 172.21.15.18:0/3736606720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf7a59c640 1 -- 172.21.15.18:0/3736606720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7c19dd50 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf7a59c640 1 --2- 172.21.15.18:0/3736606720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c19d810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009940 tx=0x7fcf6c032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf6c042070 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcf6c030c80 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7c19dfe0 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf6c037040 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.584+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7c1a0cd0 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.585+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcf6c045070 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.585+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcf6c047a20 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.585+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf7c10a980 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.589+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcf6c03c5f0 con 0x7fcf7c106250 2024-09-19T08:35:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.652+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcf7c1066d0 con 0x7fcf7c106250 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.652+0000 7fcf737fe640 1 -- 172.21.15.18:0/3736606720 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fcf7c1066d0 con 0x7fcf7c106250 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 msgr2=0x7fcf7c19d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 --2- 172.21.15.18:0/3736606720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c19d810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009940 tx=0x7fcf6c032e10 comp rx=0 tx=0).stop 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 shutdown_connections 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 --2- 172.21.15.18:0/3736606720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf7c106250 0x7fcf7c19d810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 >> 172.21.15.18:0/3736606720 conn(0x7fcf7c1019a0 msgr2=0x7fcf7c102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 shutdown_connections 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:41.653+0000 7fcf80bb1640 1 -- 172.21.15.18:0/3736606720 wait complete. 2024-09-19T08:35:42.259 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:35:42.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:42.183+0000 7fe8bb7d5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:43.018+0000 7fe8bb7d5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: Activating manager daemon x 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: mgrmap e2: x(active, starting, since 0.00299289s) 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:35:43.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T08:35:43.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:35:43.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:35:43.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' 2024-09-19T08:35:43.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' 2024-09-19T08:35:43.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:43 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/683471159' entity='mgr.x' 2024-09-19T08:35:45.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:45 smithi018 ceph-mon[30956]: mgrmap e3: x(active, since 1.00742s) 2024-09-19T08:35:45.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:45 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3077308421' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "ed3de594-7661-11ef-bceb-c7b262605968", 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:35:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:35:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:35:45.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:35:30:772232+0000", 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:35:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:35:30.772923+0000", 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f191ee640 1 Processor -- start 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f191ee640 1 -- start start 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f191ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1410a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f191ee640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1407bdd0 con 0x7f0f14107e70 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f12d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1410a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f12d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1410a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41916/0 (socket says 172.21.15.18:41916) 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.644+0000 7f0f12d9d640 1 -- 172.21.15.18:0/1065277882 learned_addr learned my addr 172.21.15.18:0/1065277882 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.645+0000 7f0f12d9d640 1 -- 172.21.15.18:0/1065277882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1410a7a0 con 0x7f0f14107e70 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.645+0000 7f0f12d9d640 1 --2- 172.21.15.18:0/1065277882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1410a260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009820 tx=0x7f0f0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8fa6f883fb4288 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f11d9b640 1 -- 172.21.15.18:0/1065277882 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f04037070 con 0x7f0f14107e70 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f11d9b640 1 -- 172.21.15.18:0/1065277882 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0f040328d0 con 0x7f0f14107e70 2024-09-19T08:35:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f11d9b640 1 -- 172.21.15.18:0/1065277882 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f040307d0 con 0x7f0f14107e70 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 -- 172.21.15.18:0/1065277882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 msgr2=0x7f0f1410a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 --2- 172.21.15.18:0/1065277882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1410a260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009820 tx=0x7f0f0402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 -- 172.21.15.18:0/1065277882 shutdown_connections 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 --2- 172.21.15.18:0/1065277882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1410a260 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 -- 172.21.15.18:0/1065277882 >> 172.21.15.18:0/1065277882 conn(0x7f0f141019d0 msgr2=0x7f0f14103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 -- 172.21.15.18:0/1065277882 shutdown_connections 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.646+0000 7f0f191ee640 1 -- 172.21.15.18:0/1065277882 wait complete. 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.647+0000 7f0f191ee640 1 Processor -- start 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.647+0000 7f0f191ee640 1 -- start start 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f191ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f191ee640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1410b720 con 0x7f0f14107e70 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f12d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f12d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41932/0 (socket says 172.21.15.18:41932) 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f12d9d640 1 -- 172.21.15.18:0/3077308421 learned_addr learned my addr 172.21.15.18:0/3077308421 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f12d9d640 1 -- 172.21.15.18:0/3077308421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1419bb30 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0f12d9d640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1419b5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f040097f0 tx=0x7f0f04030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f04037040 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.648+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0f0403b3f0 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.649+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1419bdc0 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.649+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0403a520 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.649+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f14105c60 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.650+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f0f0403a6c0 con 0x7f0f14107e70 2024-09-19T08:35:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.650+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f141082d0 con 0x7f0f14107e70 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.650+0000 7f0efbfff640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f0efc0390a0 0x7f0efc03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.650+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f0406c170 con 0x7f0f14107e70 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.650+0000 7f0f1259c640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f0efc0390a0 0x7f0efc03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.650+0000 7f0f1259c640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f0efc0390a0 0x7f0efc03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f080098c0 tx=0x7f0f08006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.655+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f04032820 con 0x7f0f14107e70 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.900+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0f14068680 con 0x7f0f14107e70 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.900+0000 7f0efbfff640 1 -- 172.21.15.18:0/3077308421 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f0f14068680 con 0x7f0f14107e70 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f0efc0390a0 msgr2=0x7f0efc03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f0efc0390a0 0x7f0efc03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f080098c0 tx=0x7f0f08006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 msgr2=0x7f0f1419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1419b5f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f040097f0 tx=0x7f0f04030d00 comp rx=0 tx=0).stop 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 shutdown_connections 2024-09-19T08:35:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f0efc0390a0 0x7f0efc03b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 --2- 172.21.15.18:0/3077308421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f14107e70 0x7f0f1419b5f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 >> 172.21.15.18:0/3077308421 conn(0x7f0f141019d0 msgr2=0x7f0f141026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 shutdown_connections 2024-09-19T08:35:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.903+0000 7f0f191ee640 1 -- 172.21.15.18:0/3077308421 wait complete. 2024-09-19T08:35:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:mgr is available 2024-09-19T08:35:46.183 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:46 smithi018 ceph-mon[30956]: mgrmap e4: x(active, since 2s) 2024-09-19T08:35:46.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:46.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:35:46.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.995+0000 7f5aba613640 1 Processor -- start 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.995+0000 7f5aba613640 1 -- start start 2024-09-19T08:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.995+0000 7f5aba613640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab410a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.995+0000 7f5aba613640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab407be10 con 0x7f5ab4107e30 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.995+0000 7f5ab3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab410a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.996+0000 7f5ab3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab410a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41934/0 (socket says 172.21.15.18:41934) 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.996+0000 7f5ab3fff640 1 -- 172.21.15.18:0/1352074821 learned_addr learned my addr 172.21.15.18:0/1352074821 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.996+0000 7f5ab3fff640 1 -- 172.21.15.18:0/1352074821 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab410a760 con 0x7f5ab4107e30 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.997+0000 7f5ab3fff640 1 --2- 172.21.15.18:0/1352074821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab410a220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009820 tx=0x7f5aa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f550d4f5465afd3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.997+0000 7f5ab2ffd640 1 -- 172.21.15.18:0/1352074821 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa4037070 con 0x7f5ab4107e30 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.997+0000 7f5ab2ffd640 1 -- 172.21.15.18:0/1352074821 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5aa40328d0 con 0x7f5ab4107e30 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.997+0000 7f5ab2ffd640 1 -- 172.21.15.18:0/1352074821 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa40307d0 con 0x7f5ab4107e30 2024-09-19T08:35:46.778 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.997+0000 7f5aba613640 1 -- 172.21.15.18:0/1352074821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 msgr2=0x7f5ab410a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.997+0000 7f5aba613640 1 --2- 172.21.15.18:0/1352074821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab410a220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009820 tx=0x7f5aa402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 -- 172.21.15.18:0/1352074821 shutdown_connections 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 --2- 172.21.15.18:0/1352074821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab410a220 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 -- 172.21.15.18:0/1352074821 >> 172.21.15.18:0/1352074821 conn(0x7f5ab41019d0 msgr2=0x7f5ab4103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 -- 172.21.15.18:0/1352074821 shutdown_connections 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 -- 172.21.15.18:0/1352074821 wait complete. 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 Processor -- start 2024-09-19T08:35:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.998+0000 7f5aba613640 1 -- start start 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5aba613640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab41076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5aba613640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab410b740 con 0x7f5ab4107e30 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5ab3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab41076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5ab3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab41076b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41948/0 (socket says 172.21.15.18:41948) 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5ab3fff640 1 -- 172.21.15.18:0/2523341332 learned_addr learned my addr 172.21.15.18:0/2523341332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5ab3fff640 1 -- 172.21.15.18:0/2523341332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab4107bf0 con 0x7f5ab4107e30 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:45.999+0000 7f5ab3fff640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab41076b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4030520 tx=0x7f5aa4032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.000+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa4042070 con 0x7f5ab4107e30 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.000+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5aa4030cc0 con 0x7f5ab4107e30 2024-09-19T08:35:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.000+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab4105de0 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.000+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aa4037040 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.000+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab4106320 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.001+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f5aa4045070 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.001+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab4108290 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.001+0000 7f5ab17fa640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f5a9c0391b0 0x7f5a9c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.001+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5aa406c240 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.001+0000 7f5ab37fe640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f5a9c0391b0 0x7f5a9c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.002+0000 7f5ab37fe640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f5a9c0391b0 0x7f5a9c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098c0 tx=0x7f5aa8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.006+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5aa4045360 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.183+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f5ab4194e30 con 0x7f5ab4107e30 2024-09-19T08:35:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.184+0000 7f5ab17fa640 1 -- 172.21.15.18:0/2523341332 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f5aa403ca90 con 0x7f5ab4107e30 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f5a9c0391b0 msgr2=0x7f5a9c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f5a9c0391b0 0x7f5a9c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098c0 tx=0x7f5aa8006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 msgr2=0x7f5ab41076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab41076b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4030520 tx=0x7f5aa4032dd0 comp rx=0 tx=0).stop 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 shutdown_connections 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f5a9c0391b0 0x7f5a9c03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 --2- 172.21.15.18:0/2523341332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab4107e30 0x7f5ab41076b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 >> 172.21.15.18:0/2523341332 conn(0x7f5ab41019d0 msgr2=0x7f5ab41026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 shutdown_connections 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.187+0000 7f5aba613640 1 -- 172.21.15.18:0/2523341332 wait complete. 2024-09-19T08:35:46.782 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling cephadm module... 2024-09-19T08:35:47.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2523341332' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:35:48.339 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1274186667' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:35:48.339 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setuser ceph since I am not root 2024-09-19T08:35:48.339 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setgroup ceph since I am not root 2024-09-19T08:35:48.339 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:48.178+0000 7f7da6929040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:35:48.339 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:48.237+0000 7f7da6929040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:48.618 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:48.392+0000 7f7da6929040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:35:48.618 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:48.461+0000 7f7da6929040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff8c29640 1 Processor -- start 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff8c29640 1 -- start start 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff8c29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff4107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff8c29640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff4107d50 con 0x7f7ff4107380 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff4107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff4107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41964/0 (socket says 172.21.15.18:41964) 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.147+0000 7f7ff259c640 1 -- 172.21.15.18:0/1858459469 learned_addr learned my addr 172.21.15.18:0/1858459469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.148+0000 7f7ff259c640 1 -- 172.21.15.18:0/1858459469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff4108580 con 0x7f7ff4107380 2024-09-19T08:35:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.148+0000 7f7ff259c640 1 --2- 172.21.15.18:0/1858459469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff4107780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009820 tx=0x7f7fe402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d89676519a29cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:48.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff159a640 1 -- 172.21.15.18:0/1858459469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4037070 con 0x7f7ff4107380 2024-09-19T08:35:48.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff159a640 1 -- 172.21.15.18:0/1858459469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7fe40328d0 con 0x7f7ff4107380 2024-09-19T08:35:48.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff159a640 1 -- 172.21.15.18:0/1858459469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe40307d0 con 0x7f7ff4107380 2024-09-19T08:35:48.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1858459469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 msgr2=0x7f7ff4107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 --2- 172.21.15.18:0/1858459469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff4107780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009820 tx=0x7f7fe402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1858459469 shutdown_connections 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 --2- 172.21.15.18:0/1858459469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff4107780 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1858459469 >> 172.21.15.18:0/1858459469 conn(0x7f7ff4102b10 msgr2=0x7f7ff4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1858459469 shutdown_connections 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.149+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1858459469 wait complete. 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff8c29640 1 Processor -- start 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff8c29640 1 -- start start 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff8c29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff8c29640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff410b930 con 0x7f7ff4107380 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41976/0 (socket says 172.21.15.18:41976) 2024-09-19T08:35:48.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.150+0000 7f7ff259c640 1 -- 172.21.15.18:0/1274186667 learned_addr learned my addr 172.21.15.18:0/1274186667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7ff259c640 1 -- 172.21.15.18:0/1274186667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff407e050 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7ff259c640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff407db10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009940 tx=0x7f7fe4032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4042070 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7fe4030c80 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff407c240 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4037040 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.151+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff407c780 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.152+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f7fe4045070 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.152+0000 7f7fe37fe640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f7fdc039160 0x7f7fdc03b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.152+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff410bab0 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.152+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7fe406c3c0 con 0x7f7ff4107380 2024-09-19T08:35:48.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.152+0000 7f7ff1d9b640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f7fdc039160 0x7f7fdc03b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.153+0000 7f7ff1d9b640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f7fdc039160 0x7f7fdc03b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80098c0 tx=0x7f7fe8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.157+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7fe4045360 con 0x7f7ff4107380 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:47.384+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f7ff407cc80 con 0x7f7ff4107380 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.030+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f7fe402f2a0 con 0x7f7ff4107380 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.032+0000 7f7fe37fe640 1 -- 172.21.15.18:0/1274186667 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f7fe403b330 con 0x7f7ff4107380 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f7fdc039160 msgr2=0x7f7fdc03b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f7fdc039160 0x7f7fdc03b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80098c0 tx=0x7f7fe8006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 msgr2=0x7f7ff407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff407db10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009940 tx=0x7f7fe4032e10 comp rx=0 tx=0).stop 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 shutdown_connections 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f7fdc039160 0x7f7fdc03b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:48.629 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 --2- 172.21.15.18:0/1274186667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ff4107380 0x7f7ff407db10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:48.630 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 >> 172.21.15.18:0/1274186667 conn(0x7f7ff4102b10 msgr2=0x7f7ff41036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:48.630 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 shutdown_connections 2024-09-19T08:35:48.630 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.034+0000 7f7ff8c29640 1 -- 172.21.15.18:0/1274186667 wait complete. 2024-09-19T08:35:48.877 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:48.615+0000 7f7da6929040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:48.877 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:48.768+0000 7f7da6929040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:35:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:49 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1274186667' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:35:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:49 smithi018 ceph-mon[30956]: mgrmap e5: x(active, since 5s) 2024-09-19T08:35:49.165 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:49.101+0000 7f7da6929040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:35:49.165 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:49.164+0000 7f7da6929040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:35:49.443 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:49.361+0000 7f7da6929040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:35:49.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:49.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:35:49.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:35:49.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.038+0000 7f2f012b8640 1 Processor -- start 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.038+0000 7f2f012b8640 1 -- start start 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.038+0000 7f2f012b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc07c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.038+0000 7f2f012b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc07c850 con 0x7f2efc07de20 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.038+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc07c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:49.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.038+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc07c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42010/0 (socket says 172.21.15.18:42010) 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.039+0000 7f2efaffd640 1 -- 172.21.15.18:0/1829133623 learned_addr learned my addr 172.21.15.18:0/1829133623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.039+0000 7f2efaffd640 1 -- 172.21.15.18:0/1829133623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc07c9d0 con 0x7f2efc07de20 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.039+0000 7f2efaffd640 1 --2- 172.21.15.18:0/1829133623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc07c280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009820 tx=0x7f2eec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1054f5a6327026e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2ef9ffb640 1 -- 172.21.15.18:0/1829133623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eec037070 con 0x7f2efc07de20 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2ef9ffb640 1 -- 172.21.15.18:0/1829133623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2eec0328d0 con 0x7f2efc07de20 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2ef9ffb640 1 -- 172.21.15.18:0/1829133623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eec0307d0 con 0x7f2efc07de20 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 -- 172.21.15.18:0/1829133623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 msgr2=0x7f2efc07c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 --2- 172.21.15.18:0/1829133623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc07c280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009820 tx=0x7f2eec02a270 comp rx=0 tx=0).stop 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 -- 172.21.15.18:0/1829133623 shutdown_connections 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 --2- 172.21.15.18:0/1829133623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc07c280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 -- 172.21.15.18:0/1829133623 >> 172.21.15.18:0/1829133623 conn(0x7f2efc102b10 msgr2=0x7f2efc104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:49.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 -- 172.21.15.18:0/1829133623 shutdown_connections 2024-09-19T08:35:49.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.040+0000 7f2f012b8640 1 -- 172.21.15.18:0/1829133623 wait complete. 2024-09-19T08:35:49.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2f012b8640 1 Processor -- start 2024-09-19T08:35:49.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2f012b8640 1 -- start start 2024-09-19T08:35:49.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2f012b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:49.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2f012b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc10d950 con 0x7f2efc07de20 2024-09-19T08:35:49.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc19d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42012/0 (socket says 172.21.15.18:42012) 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.041+0000 7f2efaffd640 1 -- 172.21.15.18:0/71882293 learned_addr learned my addr 172.21.15.18:0/71882293 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2efaffd640 1 -- 172.21.15.18:0/71882293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc19dcd0 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2efaffd640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc19d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2eec032e10 tx=0x7f2eec032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eec042070 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc19df60 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2eec030c80 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eec037040 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.042+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc1a0c50 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.043+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f2eec045070 con 0x7f2efc07de20 2024-09-19T08:35:49.883 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.043+0000 7f2ee3fff640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 0x7f2ee403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.043+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2eec06c1a0 con 0x7f2efc07de20 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.043+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc07c300 con 0x7f2efc07de20 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.043+0000 7f2efa7fc640 1 -- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 msgr2=0x7f2ee403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1687208170 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.043+0000 7f2efa7fc640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 0x7f2ee403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.048+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2eec045360 con 0x7f2efc07de20 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.244+0000 7f2efa7fc640 1 -- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 msgr2=0x7f2ee403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1687208170 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.244+0000 7f2efa7fc640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 0x7f2ee403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.276+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2efc1a0fa0 con 0x7f2efc07de20 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.277+0000 7f2ee3fff640 1 -- 172.21.15.18:0/71882293 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f2eec02ed90 con 0x7f2efc07de20 2024-09-19T08:35:49.884 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 msgr2=0x7f2ee403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 0x7f2ee403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 msgr2=0x7f2efc19d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc19d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2eec032e10 tx=0x7f2eec032e40 comp rx=0 tx=0).stop 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 shutdown_connections 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7f2ee40391b0 0x7f2ee403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 --2- 172.21.15.18:0/71882293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2efc07de20 0x7f2efc19d790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 >> 172.21.15.18:0/71882293 conn(0x7f2efc102b10 msgr2=0x7f2efc103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 shutdown_connections 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.279+0000 7f2f012b8640 1 -- 172.21.15.18:0/71882293 wait complete. 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-19T08:35:49.885 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 5... 2024-09-19T08:35:50.181 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/71882293' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:35:50.443 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:50.299+0000 7f7da6929040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:35:50.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:50.369+0000 7f7da6929040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:35:51.194 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.110+0000 7f7da6929040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:35:51.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.230+0000 7f7da6929040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:35:51.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.378+0000 7f7da6929040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:51.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.442+0000 7f7da6929040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:35:51.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.598+0000 7f7da6929040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:35:51.895 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.668+0000 7f7da6929040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:35:51.896 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.731+0000 7f7da6929040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:35:51.896 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.896+0000 7f7da6929040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:35:52.179 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:51.963+0000 7f7da6929040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:35:52.179 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:52.032+0000 7f7da6929040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:35:52.180 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:52.118+0000 7f7da6929040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:52.180 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:52.179+0000 7f7da6929040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:35:52.443 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:52.241+0000 7f7da6929040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:53.064+0000 7f7da6929040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: Activating manager daemon x 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: mgrmap e6: x(active, starting, since 0.00336762s) 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:35:53.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:35:53.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:53 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.261+0000 7fbd1f92c640 1 Processor -- start 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1f92c640 1 -- start start 2024-09-19T08:35:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1f92c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd18106660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1f92c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd18106c30 con 0x7fbd18106260 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1d6c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd18106660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1d6c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd18106660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59976/0 (socket says 172.21.15.18:59976) 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1d6c8640 1 -- 172.21.15.18:0/3009180940 learned_addr learned my addr 172.21.15.18:0/3009180940 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.262+0000 7fbd1d6c8640 1 -- 172.21.15.18:0/3009180940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd18107460 con 0x7fbd18106260 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd1d6c8640 1 --2- 172.21.15.18:0/3009180940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd18106660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009820 tx=0x7fbd1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c748403293bfc300 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd0ffff640 1 -- 172.21.15.18:0/3009180940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd14037070 con 0x7fbd18106260 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd0ffff640 1 -- 172.21.15.18:0/3009180940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbd140328d0 con 0x7fbd18106260 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd0ffff640 1 -- 172.21.15.18:0/3009180940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd140307d0 con 0x7fbd18106260 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3009180940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 msgr2=0x7fbd18106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3009180940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd18106660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009820 tx=0x7fbd1402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3009180940 shutdown_connections 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3009180940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd18106660 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.264+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3009180940 >> 172.21.15.18:0/3009180940 conn(0x7fbd181019b0 msgr2=0x7fbd18103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.265+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3009180940 shutdown_connections 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.265+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3009180940 wait complete. 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.265+0000 7fbd1f92c640 1 Processor -- start 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.265+0000 7fbd1f92c640 1 -- start start 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1f92c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd1819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1f92c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1810a810 con 0x7fbd18106260 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1d6c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd1819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1d6c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd1819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59978/0 (socket says 172.21.15.18:59978) 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1d6c8640 1 -- 172.21.15.18:0/3103193294 learned_addr learned my addr 172.21.15.18:0/3103193294 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:54.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1d6c8640 1 -- 172.21.15.18:0/3103193294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1819aa50 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1d6c8640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd1819a510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009940 tx=0x7fbd14032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd14042070 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbd14030c80 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1819ace0 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd14037040 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.266+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1819d9d0 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.268+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fbd14045070 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.268+0000 7fbd0e7fc640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.268+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 --> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbd0403bdd0 con 0x7fbd04039200 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.268+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbd1406c080 con 0x7fbd18106260 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.268+0000 7fbd1cec7640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 msgr2=0x7fbd0403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1687208170 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.268+0000 7fbd1cec7640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:35:54.646 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.469+0000 7fbd1cec7640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 msgr2=0x7fbd0403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1687208170 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.469+0000 7fbd1cec7640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.870+0000 7fbd1cec7640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 msgr2=0x7fbd0403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1687208170 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:50.870+0000 7fbd1cec7640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.671+0000 7fbd1cec7640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 msgr2=0x7fbd0403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1687208170 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.671+0000 7fbd1cec7640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.067+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fbd1406ac00 con 0x7fbd18106260 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.068+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 msgr2=0x7fbd0403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.068+0000 7fbd0e7fc640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.069+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fbd140313a0 con 0x7fbd18106260 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.069+0000 7fbd0e7fc640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fbd0403cb30 0x7fbd0403ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.069+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbd1402bba0 con 0x7fbd0403cb30 2024-09-19T08:35:54.647 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.069+0000 7fbd1cec7640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fbd0403cb30 0x7fbd0403ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.070+0000 7fbd1cec7640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fbd0403cb30 0x7fbd0403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd08003980 tx=0x7fbd080092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.071+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fbd1402bba0 con 0x7fbd0403cb30 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbd1810a990 con 0x7fbd0403cb30 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd0e7fc640 1 -- 172.21.15.18:0/3103193294 <== mgr.14118 v2:172.21.15.18:6800/4188004415 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fbd1810a990 con 0x7fbd0403cb30 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fbd0403cb30 msgr2=0x7fbd0403ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fbd0403cb30 0x7fbd0403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd08003980 tx=0x7fbd080092b0 comp rx=0 tx=0).stop 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 msgr2=0x7fbd1819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd1819a510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009940 tx=0x7fbd14032e10 comp rx=0 tx=0).stop 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 shutdown_connections 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fbd0403cb30 0x7fbd0403ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:6800/1687208170,v1:172.21.15.18:6801/1687208170] conn(0x7fbd04039200 0x7fbd0403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 --2- 172.21.15.18:0/3103193294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd18106260 0x7fbd1819a510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:54.649 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.078+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 >> 172.21.15.18:0/3103193294 conn(0x7fbd181019b0 msgr2=0x7fbd18102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:54.649 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.079+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 shutdown_connections 2024-09-19T08:35:54.649 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.079+0000 7fbd1f92c640 1 -- 172.21.15.18:0/3103193294 wait complete. 2024-09-19T08:35:54.649 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 5 is available 2024-09-19T08:35:54.649 INFO:teuthology.orchestra.run.smithi018.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:35:55.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-mon[30956]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:35:55.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-mon[30956]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:35:55.252 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-mon[30956]: mgrmap e7: x(active, since 1.00604s) 2024-09-19T08:35:55.252 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-mon[30956]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:35:55.252 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:55.252 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.050+0000 7f6204be3640 1 Processor -- start 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.050+0000 7f6204be3640 1 -- start start 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.051+0000 7f6204be3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200106650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.051+0000 7f6204be3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6200106c20 con 0x7f6200106250 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.051+0000 7f61fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.051+0000 7f61fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200106650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60048/0 (socket says 172.21.15.18:60048) 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.051+0000 7f61fe59c640 1 -- 172.21.15.18:0/2444640478 learned_addr learned my addr 172.21.15.18:0/2444640478 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.051+0000 7f61fe59c640 1 -- 172.21.15.18:0/2444640478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6200107450 con 0x7f6200106250 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.052+0000 7f61fe59c640 1 --2- 172.21.15.18:0/2444640478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200106650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61f000bac0 tx=0x7f61f002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e2850833a8f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.052+0000 7f61fdd9b640 1 -- 172.21.15.18:0/2444640478 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f00326d0 con 0x7f6200106250 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.052+0000 7f61fdd9b640 1 -- 172.21.15.18:0/2444640478 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f61f0038070 con 0x7f6200106250 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.052+0000 7f61fdd9b640 1 -- 172.21.15.18:0/2444640478 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0033c90 con 0x7f6200106250 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 -- 172.21.15.18:0/2444640478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 msgr2=0x7f6200106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 --2- 172.21.15.18:0/2444640478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200106650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61f000bac0 tx=0x7f61f002c920 comp rx=0 tx=0).stop 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 -- 172.21.15.18:0/2444640478 shutdown_connections 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 --2- 172.21.15.18:0/2444640478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200106650 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 -- 172.21.15.18:0/2444640478 >> 172.21.15.18:0/2444640478 conn(0x7f62001019a0 msgr2=0x7f6200103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 -- 172.21.15.18:0/2444640478 shutdown_connections 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 -- 172.21.15.18:0/2444640478 wait complete. 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.053+0000 7f6204be3640 1 Processor -- start 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f6204be3640 1 -- start start 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f6204be3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f6204be3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62000748c0 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60060/0 (socket says 172.21.15.18:60060) 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61fe59c640 1 -- 172.21.15.18:0/1494928233 learned_addr learned my addr 172.21.15.18:0/1494928233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61fe59c640 1 -- 172.21.15.18:0/1494928233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6200199960 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61fe59c640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200199420 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61f000b2c0 tx=0x7f61f00327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0042070 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f61f0032bf0 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f003c580 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.054+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6200199bf0 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.055+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620019c8e0 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.056+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f61f0046920 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.055+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62001066d0 con 0x7f6200106250 2024-09-19T08:35:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.056+0000 7f61f77fe640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61ec0390f0 0x7f61ec03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.056+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f61f0030050 con 0x7f6200106250 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.056+0000 7f61f7fff640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61ec0390f0 0x7f61ec03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.056+0000 7f61f7fff640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61ec0390f0 0x7f61ec03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61e80098c0 tx=0x7f61e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.061+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61f00401e0 con 0x7f6200106250 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.252+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f6200062630 con 0x7f61ec0390f0 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.257+0000 7f61f77fe640 1 -- 172.21.15.18:0/1494928233 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6200062630 con 0x7f61ec0390f0 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.259+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61ec0390f0 msgr2=0x7f61ec03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.259+0000 7f6204be3640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61ec0390f0 0x7f61ec03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61e80098c0 tx=0x7f61e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.259+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 msgr2=0x7f6200199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.259+0000 7f6204be3640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200199420 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61f000b2c0 tx=0x7f61f00327d0 comp rx=0 tx=0).stop 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.260+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 shutdown_connections 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.260+0000 7f6204be3640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61ec0390f0 0x7f61ec03b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:55.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.260+0000 7f6204be3640 1 --2- 172.21.15.18:0/1494928233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6200106250 0x7f6200199420 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.260+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 >> 172.21.15.18:0/1494928233 conn(0x7f62001019a0 msgr2=0x7f620018f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.260+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 shutdown_connections 2024-09-19T08:35:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.260+0000 7f6204be3640 1 -- 172.21.15.18:0/1494928233 wait complete. 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:55.915+0000 7f7d1344e640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:35:55] ENGINE Error in HTTPServer.serve 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: Traceback (most recent call last): 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self._connections.run(self.expiration_interval) 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self._run(expiration_interval) 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:35:56.185 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: s = self.context.wrap_socket( 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: return self.sslsocket_class._create( 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self.do_handshake() 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self._sslobj.do_handshake() 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:35:56.186 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: mgrmap e8: x(active, since 2s) 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: [19/Sep/2024:08:35:55] ENGINE Bus STARTING 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: [19/Sep/2024:08:35:55] ENGINE Serving on https://172.21.15.18:7150 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: [19/Sep/2024:08:35:55] ENGINE Error in HTTPServer.serve 2024-09-19T08:35:56.444 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-19T08:35:56.445 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: [19/Sep/2024:08:35:56] ENGINE Serving on http://172.21.15.18:8765 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: [19/Sep/2024:08:35:56] ENGINE Bus STARTED 2024-09-19T08:35:56.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:56 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc94e280640 1 Processor -- start 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc94e280640 1 -- start start 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc94e280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94810a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc94e280640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9480757a0 con 0x7fc948107dd0 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc947fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94810a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc947fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94810a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60074/0 (socket says 172.21.15.18:60074) 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.264+0000 7fc947fff640 1 -- 172.21.15.18:0/3675904211 learned_addr learned my addr 172.21.15.18:0/3675904211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.265+0000 7fc947fff640 1 -- 172.21.15.18:0/3675904211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94810a700 con 0x7fc948107dd0 2024-09-19T08:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.265+0000 7fc947fff640 1 --2- 172.21.15.18:0/3675904211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94810a1c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc938009820 tx=0x7fc93802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf73082d348d645 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.265+0000 7fc946ffd640 1 -- 172.21.15.18:0/3675904211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc938037070 con 0x7fc948107dd0 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.265+0000 7fc946ffd640 1 -- 172.21.15.18:0/3675904211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc9380328d0 con 0x7fc948107dd0 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc946ffd640 1 -- 172.21.15.18:0/3675904211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9380307d0 con 0x7fc948107dd0 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 -- 172.21.15.18:0/3675904211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 msgr2=0x7fc94810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 --2- 172.21.15.18:0/3675904211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94810a1c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc938009820 tx=0x7fc93802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 -- 172.21.15.18:0/3675904211 shutdown_connections 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 --2- 172.21.15.18:0/3675904211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94810a1c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 -- 172.21.15.18:0/3675904211 >> 172.21.15.18:0/3675904211 conn(0x7fc9481019b0 msgr2=0x7fc948103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 -- 172.21.15.18:0/3675904211 shutdown_connections 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.266+0000 7fc94e280640 1 -- 172.21.15.18:0/3675904211 wait complete. 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc94e280640 1 Processor -- start 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc94e280640 1 -- start start 2024-09-19T08:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc94e280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc94e280640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc94810b740 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc947fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc947fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94819b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60088/0 (socket says 172.21.15.18:60088) 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc947fff640 1 -- 172.21.15.18:0/3004492540 learned_addr learned my addr 172.21.15.18:0/3004492540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.267+0000 7fc947fff640 1 -- 172.21.15.18:0/3004492540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94819bb10 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.268+0000 7fc947fff640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94819b5d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc938032e10 tx=0x7fc938032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.268+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc938042070 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.268+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc938030c80 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.268+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94819bda0 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.268+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc938037040 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.268+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94819ea90 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.269+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc938045070 con 0x7fc948107dd0 2024-09-19T08:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.269+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc948108230 con 0x7fc948107dd0 2024-09-19T08:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.269+0000 7fc9457fa640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc9300391b0 0x7fc93003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.269+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc93806c380 con 0x7fc948107dd0 2024-09-19T08:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.269+0000 7fc9477fe640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc9300391b0 0x7fc93003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.269+0000 7fc9477fe640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc9300391b0 0x7fc93003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0098c0 tx=0x7fc93c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.274+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc938045360 con 0x7fc948107dd0 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.451+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fc948062630 con 0x7fc9300391b0 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.451+0000 7fc9457fa640 1 -- 172.21.15.18:0/3004492540 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fc948062630 con 0x7fc9300391b0 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc9300391b0 msgr2=0x7fc93003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc9300391b0 0x7fc93003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0098c0 tx=0x7fc93c006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 msgr2=0x7fc94819b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94819b5d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc938032e10 tx=0x7fc938032e40 comp rx=0 tx=0).stop 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 shutdown_connections 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc9300391b0 0x7fc93003b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 --2- 172.21.15.18:0/3004492540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc948107dd0 0x7fc94819b5d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 >> 172.21.15.18:0/3004492540 conn(0x7fc9481019b0 msgr2=0x7fc948102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 shutdown_connections 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.454+0000 7fc94e280640 1 -- 172.21.15.18:0/3004492540 wait complete. 2024-09-19T08:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout:Generating ssh key... 2024-09-19T08:35:57.357 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-mon[30956]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: Generating public/private rsa key pair. 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: Your identification has been saved in /tmp/tmp70zbc5nu/key 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: Your public key has been saved in /tmp/tmp70zbc5nu/key.pub 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: The key fingerprint is: 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: SHA256:QGZScmdIQxxarPh2s5JDz0M5S7c41lDPbW7LAldutl0 ceph-ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: The key's randomart image is: 2024-09-19T08:35:57.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: +---[RSA 3072]----+ 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | o*%oo | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | X++ | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | .... | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | . . .. . | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | . oSo + | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | + O o + * E| 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | o B X + = o . | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | + X o ..+ . | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: | + o oo. | 2024-09-19T08:35:57.945 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:35:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: +----[SHA256]-----+ 2024-09-19T08:35:58.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.438+0000 7fc7d1ffd640 1 Processor -- start 2024-09-19T08:35:58.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.438+0000 7fc7d1ffd640 1 -- start start 2024-09-19T08:35:58.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.439+0000 7fc7d1ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc10a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.439+0000 7fc7d1ffd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc0757a0 con 0x7fc7cc107dc0 2024-09-19T08:35:58.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.439+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc10a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.439+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc10a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60090/0 (socket says 172.21.15.18:60090) 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.439+0000 7fc7cb7fe640 1 -- 172.21.15.18:0/81385316 learned_addr learned my addr 172.21.15.18:0/81385316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.439+0000 7fc7cb7fe640 1 -- 172.21.15.18:0/81385316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc10a6f0 con 0x7fc7cc107dc0 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.440+0000 7fc7cb7fe640 1 --2- 172.21.15.18:0/81385316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc10a1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009e80 tx=0x7fc7bc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b15cf609d6e097b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.440+0000 7fc7ca7fc640 1 -- 172.21.15.18:0/81385316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc036070 con 0x7fc7cc107dc0 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.440+0000 7fc7ca7fc640 1 -- 172.21.15.18:0/81385316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc7bc031890 con 0x7fc7cc107dc0 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.440+0000 7fc7ca7fc640 1 -- 172.21.15.18:0/81385316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc007980 con 0x7fc7cc107dc0 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.440+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/81385316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 msgr2=0x7fc7cc10a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.440+0000 7fc7d1ffd640 1 --2- 172.21.15.18:0/81385316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc10a1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009e80 tx=0x7fc7bc02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/81385316 shutdown_connections 2024-09-19T08:35:58.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 --2- 172.21.15.18:0/81385316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc10a1b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/81385316 >> 172.21.15.18:0/81385316 conn(0x7fc7cc1019a0 msgr2=0x7fc7cc103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/81385316 shutdown_connections 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/81385316 wait complete. 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 Processor -- start 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.441+0000 7fc7d1ffd640 1 -- start start 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7d1ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7d1ffd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc10b730 con 0x7fc7cc107dc0 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60100/0 (socket says 172.21.15.18:60100) 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7cb7fe640 1 -- 172.21.15.18:0/825691712 learned_addr learned my addr 172.21.15.18:0/825691712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7cb7fe640 1 -- 172.21.15.18:0/825691712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc19bb00 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7cb7fe640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc19b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009680 tx=0x7fc7bc031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc041020 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc7bc03c900 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc19bd90 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc036040 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.442+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc19ea80 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.443+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc7bc044020 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.443+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7cc108220 con 0x7fc7cc107dc0 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.443+0000 7fc7c8ff9640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc7b80391b0 0x7fc7b803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.444+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc7bc06d770 con 0x7fc7cc107dc0 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.444+0000 7fc7caffd640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc7b80391b0 0x7fc7b803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.444+0000 7fc7caffd640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc7b80391b0 0x7fc7b803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40098c0 tx=0x7fc7b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.448+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7bc04b020 con 0x7fc7cc107dc0 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.626+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fc7cc02d860 con 0x7fc7b80391b0 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.745+0000 7fc7c8ff9640 1 -- 172.21.15.18:0/825691712 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc7cc02d860 con 0x7fc7b80391b0 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc7b80391b0 msgr2=0x7fc7b803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc7b80391b0 0x7fc7b803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40098c0 tx=0x7fc7b4006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 msgr2=0x7fc7cc19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc19b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009680 tx=0x7fc7bc031c70 comp rx=0 tx=0).stop 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 shutdown_connections 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fc7b80391b0 0x7fc7b803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 --2- 172.21.15.18:0/825691712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7cc107dc0 0x7fc7cc19b5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.340 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 >> 172.21.15.18:0/825691712 conn(0x7fc7cc1019a0 msgr2=0x7fc7cc1026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:58.340 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 shutdown_connections 2024-09-19T08:35:58.340 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.748+0000 7fc7d1ffd640 1 -- 172.21.15.18:0/825691712 wait complete. 2024-09-19T08:35:58.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:58 smithi018 ceph-mon[30956]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:58.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:58 smithi018 ceph-mon[30956]: Generating ssh key... 2024-09-19T08:35:58.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:58 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:58.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:58 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa9013a0640 1 Processor -- start 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa9013a0640 1 -- start start 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa9013a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc10a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa9013a0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc07be10 con 0x7fa8fc107e30 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa8faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc10a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa8faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc10a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60114/0 (socket says 172.21.15.18:60114) 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.710+0000 7fa8faffd640 1 -- 172.21.15.18:0/3512815058 learned_addr learned my addr 172.21.15.18:0/3512815058 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.711+0000 7fa8faffd640 1 -- 172.21.15.18:0/3512815058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8fc10a760 con 0x7fa8fc107e30 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.711+0000 7fa8faffd640 1 --2- 172.21.15.18:0/3512815058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc10a220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009e80 tx=0x7fa8ec02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccd0f9dc247d0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:59.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa8f9ffb640 1 -- 172.21.15.18:0/3512815058 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ec036070 con 0x7fa8fc107e30 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa8f9ffb640 1 -- 172.21.15.18:0/3512815058 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa8ec031890 con 0x7fa8fc107e30 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa8f9ffb640 1 -- 172.21.15.18:0/3512815058 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ec007980 con 0x7fa8fc107e30 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 -- 172.21.15.18:0/3512815058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 msgr2=0x7fa8fc10a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 --2- 172.21.15.18:0/3512815058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc10a220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009e80 tx=0x7fa8ec02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 -- 172.21.15.18:0/3512815058 shutdown_connections 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 --2- 172.21.15.18:0/3512815058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc10a220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 -- 172.21.15.18:0/3512815058 >> 172.21.15.18:0/3512815058 conn(0x7fa8fc1019d0 msgr2=0x7fa8fc103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 -- 172.21.15.18:0/3512815058 shutdown_connections 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.712+0000 7fa9013a0640 1 -- 172.21.15.18:0/3512815058 wait complete. 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa9013a0640 1 Processor -- start 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa9013a0640 1 -- start start 2024-09-19T08:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa9013a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:59.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa9013a0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc10b740 con 0x7fa8fc107e30 2024-09-19T08:35:59.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa8faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:59.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa8faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60120/0 (socket says 172.21.15.18:60120) 2024-09-19T08:35:59.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.713+0000 7fa8faffd640 1 -- 172.21.15.18:0/810835071 learned_addr learned my addr 172.21.15.18:0/810835071 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa8faffd640 1 -- 172.21.15.18:0/810835071 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8fc19bab0 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa8faffd640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc19b570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec031c70 tx=0x7fa8ec031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ec041020 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa8ec03c900 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8fc19bd40 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ec036040 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.714+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8fc19ea30 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.715+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa8ec044020 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.715+0000 7fa8f3fff640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fa8e8039200 0x7fa8e803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.715+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc108290 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.715+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa8ec06d6e0 con 0x7fa8fc107e30 2024-09-19T08:35:59.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.715+0000 7fa8fa7fc640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fa8e8039200 0x7fa8e803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.716+0000 7fa8fa7fc640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fa8e8039200 0x7fa8e803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098c0 tx=0x7fa8e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.720+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8ec04b020 con 0x7fa8fc107e30 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.895+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fa8fc102d10 con 0x7fa8e8039200 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.896+0000 7fa8f3fff640 1 -- 172.21.15.18:0/810835071 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fa8fc102d10 con 0x7fa8e8039200 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.899+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fa8e8039200 msgr2=0x7fa8e803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.899+0000 7fa9013a0640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fa8e8039200 0x7fa8e803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098c0 tx=0x7fa8e4006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.899+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 msgr2=0x7fa8fc19b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.899+0000 7fa9013a0640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc19b570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec031c70 tx=0x7fa8ec031ca0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.900+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 shutdown_connections 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.900+0000 7fa9013a0640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fa8e8039200 0x7fa8e803b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.900+0000 7fa9013a0640 1 --2- 172.21.15.18:0/810835071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8fc107e30 0x7fa8fc19b570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.488 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.900+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 >> 172.21.15.18:0/810835071 conn(0x7fa8fc1019d0 msgr2=0x7fa8fc1025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:59.488 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.900+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 shutdown_connections 2024-09-19T08:35:59.488 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:58.900+0000 7fa9013a0640 1 -- 172.21.15.18:0/810835071 wait complete. 2024-09-19T08:35:59.488 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:35:59.488 INFO:teuthology.orchestra.run.smithi018.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:35:59.489 INFO:teuthology.orchestra.run.smithi018.stdout:Adding host smithi018... 2024-09-19T08:35:59.869 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:35:59 smithi018 ceph-mon[30956]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:01.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:01 smithi018 ceph-mon[30956]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:02.406 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:02 smithi018 ceph-mon[30956]: Deploying cephadm binary to smithi018 2024-09-19T08:36:04.652 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Added host 'smithi018' with addr '172.21.15.18' 2024-09-19T08:36:04.652 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.962+0000 7fe112d8e640 1 Processor -- start 2024-09-19T08:36:04.652 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.962+0000 7fe112d8e640 1 -- start start 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.963+0000 7fe112d8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c10a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.963+0000 7fe112d8e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c075740 con 0x7fe10c107e20 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.963+0000 7fe110b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c10a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.963+0000 7fe110b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c10a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58120/0 (socket says 172.21.15.18:58120) 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.963+0000 7fe110b2a640 1 -- 172.21.15.18:0/1308932858 learned_addr learned my addr 172.21.15.18:0/1308932858 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.963+0000 7fe110b2a640 1 -- 172.21.15.18:0/1308932858 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c10a750 con 0x7fe10c107e20 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.964+0000 7fe110b2a640 1 --2- 172.21.15.18:0/1308932858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c10a210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009820 tx=0x7fe0fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bae7e30eb2d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.964+0000 7fe10b7fe640 1 -- 172.21.15.18:0/1308932858 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0fc037070 con 0x7fe10c107e20 2024-09-19T08:36:04.653 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.964+0000 7fe10b7fe640 1 -- 172.21.15.18:0/1308932858 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe0fc0328d0 con 0x7fe10c107e20 2024-09-19T08:36:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.964+0000 7fe10b7fe640 1 -- 172.21.15.18:0/1308932858 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0fc0307d0 con 0x7fe10c107e20 2024-09-19T08:36:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 -- 172.21.15.18:0/1308932858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 msgr2=0x7fe10c10a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 --2- 172.21.15.18:0/1308932858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c10a210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009820 tx=0x7fe0fc02a270 comp rx=0 tx=0).stop 2024-09-19T08:36:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 -- 172.21.15.18:0/1308932858 shutdown_connections 2024-09-19T08:36:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 --2- 172.21.15.18:0/1308932858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c10a210 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 -- 172.21.15.18:0/1308932858 >> 172.21.15.18:0/1308932858 conn(0x7fe10c1019a0 msgr2=0x7fe10c103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 -- 172.21.15.18:0/1308932858 shutdown_connections 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.965+0000 7fe112d8e640 1 -- 172.21.15.18:0/1308932858 wait complete. 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe112d8e640 1 Processor -- start 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe112d8e640 1 -- start start 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe112d8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c1076a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe112d8e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c10b730 con 0x7fe10c107e20 2024-09-19T08:36:04.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe110b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c1076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe110b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c1076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58132/0 (socket says 172.21.15.18:58132) 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe110b2a640 1 -- 172.21.15.18:0/215409310 learned_addr learned my addr 172.21.15.18:0/215409310 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe110b2a640 1 -- 172.21.15.18:0/215409310 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c107be0 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.966+0000 7fe110b2a640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c1076a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0097f0 tx=0x7fe0fc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.967+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0fc037040 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.967+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c105dd0 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.967+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c106310 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.967+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe0fc032bb0 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.967+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0fc03b3f0 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.968+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe0fc03b590 con 0x7fe10c107e20 2024-09-19T08:36:04.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.968+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c108280 con 0x7fe10c107e20 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.968+0000 7fe109ffb640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe0f4039200 0x7fe0f403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.968+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe0fc06c3d0 con 0x7fe10c107e20 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.968+0000 7fe10bfff640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe0f4039200 0x7fe0f403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.969+0000 7fe10bfff640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe0f4039200 0x7fe0f403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1000098c0 tx=0x7fe100006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.973+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0fc039930 con 0x7fe10c107e20 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.154+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}) -- 0x7fe10c194dc0 con 0x7fe0f4039200 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.065+0000 7fe109ffb640 1 -- 172.21.15.18:0/215409310 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe10c194dc0 con 0x7fe0f4039200 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe0f4039200 msgr2=0x7fe0f403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe0f4039200 0x7fe0f403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1000098c0 tx=0x7fe100006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 msgr2=0x7fe10c1076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c1076a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0097f0 tx=0x7fe0fc030d00 comp rx=0 tx=0).stop 2024-09-19T08:36:04.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 shutdown_connections 2024-09-19T08:36:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe0f4039200 0x7fe0f403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 --2- 172.21.15.18:0/215409310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe10c107e20 0x7fe10c1076a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 >> 172.21.15.18:0/215409310 conn(0x7fe10c1019a0 msgr2=0x7fe10c1026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 shutdown_connections 2024-09-19T08:36:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:04.069+0000 7fe112d8e640 1 -- 172.21.15.18:0/215409310 wait complete. 2024-09-19T08:36:04.658 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mon service... 2024-09-19T08:36:05.311 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:05 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:05.312 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:05 smithi018 ceph-mon[30956]: Added host smithi018 2024-09-19T08:36:05.312 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:05 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:06.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:06 smithi018 ceph-mon[30956]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:06.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:06 smithi018 ceph-mon[30956]: Saving service mon spec with placement count:5 2024-09-19T08:36:06.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:06.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:36:06.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04cf00c640 1 Processor -- start 2024-09-19T08:36:06.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04cf00c640 1 -- start start 2024-09-19T08:36:06.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04cf00c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c8108e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:06.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04cf00c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04c8107040 con 0x7f04c8108a60 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04ccda8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c8108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04ccda8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c8108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58136/0 (socket says 172.21.15.18:58136) 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04ccda8640 1 -- 172.21.15.18:0/3679061316 learned_addr learned my addr 172.21.15.18:0/3679061316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.106+0000 7f04ccda8640 1 -- 172.21.15.18:0/3679061316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c81071c0 con 0x7f04c8108a60 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.107+0000 7f04ccda8640 1 --2- 172.21.15.18:0/3679061316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c8108e60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009820 tx=0x7f04bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355f6b18416338a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.107+0000 7f04c77fe640 1 -- 172.21.15.18:0/3679061316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc037070 con 0x7f04c8108a60 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.107+0000 7f04c77fe640 1 -- 172.21.15.18:0/3679061316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f04bc0328d0 con 0x7f04c8108a60 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.107+0000 7f04c77fe640 1 -- 172.21.15.18:0/3679061316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc0307d0 con 0x7f04c8108a60 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 -- 172.21.15.18:0/3679061316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 msgr2=0x7f04c8108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 --2- 172.21.15.18:0/3679061316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c8108e60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009820 tx=0x7f04bc02a270 comp rx=0 tx=0).stop 2024-09-19T08:36:06.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 -- 172.21.15.18:0/3679061316 shutdown_connections 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 --2- 172.21.15.18:0/3679061316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c8108e60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 -- 172.21.15.18:0/3679061316 >> 172.21.15.18:0/3679061316 conn(0x7f04c8102b70 msgr2=0x7f04c8104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 -- 172.21.15.18:0/3679061316 shutdown_connections 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 -- 172.21.15.18:0/3679061316 wait complete. 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.108+0000 7f04cf00c640 1 Processor -- start 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04cf00c640 1 -- start start 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04cf00c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04cf00c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04c810b930 con 0x7f04c8108a60 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04ccda8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04ccda8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58152/0 (socket says 172.21.15.18:58152) 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04ccda8640 1 -- 172.21.15.18:0/2300006383 learned_addr learned my addr 172.21.15.18:0/2300006383 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:06.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04ccda8640 1 -- 172.21.15.18:0/2300006383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c819bc80 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04ccda8640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c819b740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009940 tx=0x7f04bc032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc042070 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f04bc030c80 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.109+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc037040 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.110+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c819bf10 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.110+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c819ec00 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.111+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f04bc045070 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.111+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c8108ee0 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.111+0000 7f04c5ffb640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f04b8039200 0x7f04b803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.111+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f04bc06c100 con 0x7f04c8108a60 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.111+0000 7f04c7fff640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f04b8039200 0x7f04b803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:06.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.111+0000 7f04c7fff640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f04b8039200 0x7f04b803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04b40098c0 tx=0x7f04b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.116+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04bc045360 con 0x7f04c8108a60 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.312+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f04c8062630 con 0x7f04b8039200 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.316+0000 7f04c5ffb640 1 -- 172.21.15.18:0/2300006383 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f04c8062630 con 0x7f04b8039200 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.318+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f04b8039200 msgr2=0x7f04b803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f04b8039200 0x7f04b803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04b40098c0 tx=0x7f04b4006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 msgr2=0x7f04c819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c819b740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009940 tx=0x7f04bc032e10 comp rx=0 tx=0).stop 2024-09-19T08:36:06.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 shutdown_connections 2024-09-19T08:36:06.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f04b8039200 0x7f04b803b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:06.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 --2- 172.21.15.18:0/2300006383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c8108a60 0x7f04c819b740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:06.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 >> 172.21.15.18:0/2300006383 conn(0x7f04c8102b70 msgr2=0x7f04c8103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:06.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 shutdown_connections 2024-09-19T08:36:06.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:05.319+0000 7f04cf00c640 1 -- 172.21.15.18:0/2300006383 wait complete. 2024-09-19T08:36:06.955 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mgr service... 2024-09-19T08:36:07.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:07 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.428+0000 7f619bbfb640 1 Processor -- start 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.428+0000 7f619bbfb640 1 -- start start 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.428+0000 7f619bbfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f619410a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.428+0000 7f619bbfb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61940757a0 con 0x7f6194107dc0 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.429+0000 7f6199997640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f619410a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.429+0000 7f6199997640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f619410a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58162/0 (socket says 172.21.15.18:58162) 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.429+0000 7f6199997640 1 -- 172.21.15.18:0/3283877878 learned_addr learned my addr 172.21.15.18:0/3283877878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.429+0000 7f6199997640 1 -- 172.21.15.18:0/3283877878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619410a6f0 con 0x7f6194107dc0 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f6199997640 1 --2- 172.21.15.18:0/3283877878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f619410a1b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6190009820 tx=0x7f619002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c352f753edbab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f6198995640 1 -- 172.21.15.18:0/3283877878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6190037070 con 0x7f6194107dc0 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f6198995640 1 -- 172.21.15.18:0/3283877878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61900328f0 con 0x7f6194107dc0 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f6198995640 1 -- 172.21.15.18:0/3283877878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6190030740 con 0x7f6194107dc0 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f619bbfb640 1 -- 172.21.15.18:0/3283877878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 msgr2=0x7f619410a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f619bbfb640 1 --2- 172.21.15.18:0/3283877878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f619410a1b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6190009820 tx=0x7f619002a270 comp rx=0 tx=0).stop 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f619bbfb640 1 -- 172.21.15.18:0/3283877878 shutdown_connections 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f619bbfb640 1 --2- 172.21.15.18:0/3283877878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f619410a1b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.430+0000 7f619bbfb640 1 -- 172.21.15.18:0/3283877878 >> 172.21.15.18:0/3283877878 conn(0x7f61941019a0 msgr2=0x7f6194103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f619bbfb640 1 -- 172.21.15.18:0/3283877878 shutdown_connections 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f619bbfb640 1 -- 172.21.15.18:0/3283877878 wait complete. 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f619bbfb640 1 Processor -- start 2024-09-19T08:36:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f619bbfb640 1 -- start start 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f619bbfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f6194107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f619bbfb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f619410b770 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f6199997640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f6194107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f6199997640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f6194107640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58176/0 (socket says 172.21.15.18:58176) 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.431+0000 7f6199997640 1 -- 172.21.15.18:0/1548877279 learned_addr learned my addr 172.21.15.18:0/1548877279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f6199997640 1 -- 172.21.15.18:0/1548877279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6194107b80 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f6199997640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f6194107640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6190030cc0 tx=0x7f6190030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6190042070 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6194105d70 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6190030e60 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6190037040 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.432+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61941062b0 con 0x7f6194107dc0 2024-09-19T08:36:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.433+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6190045070 con 0x7f6194107dc0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.433+0000 7f618affd640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61800391b0 0x7f618003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.433+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f619006c330 con 0x7f6194107dc0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.433+0000 7f6199196640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61800391b0 0x7f618003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.433+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6194108220 con 0x7f6194107dc0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.434+0000 7f6199196640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61800391b0 0x7f618003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61840098c0 tx=0x7f6184006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.438+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f619004b170 con 0x7f6194107dc0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.663+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6194194c90 con 0x7f61800391b0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.667+0000 7f618affd640 1 -- 172.21.15.18:0/1548877279 <== mgr.14118 v2:172.21.15.18:6800/4188004415 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6194194c90 con 0x7f61800391b0 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61800391b0 msgr2=0x7f618003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61800391b0 0x7f618003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61840098c0 tx=0x7f6184006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 msgr2=0x7f6194107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f6194107640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6190030cc0 tx=0x7f6190030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 shutdown_connections 2024-09-19T08:36:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f61800391b0 0x7f618003b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 --2- 172.21.15.18:0/1548877279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6194107dc0 0x7f6194107640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 >> 172.21.15.18:0/1548877279 conn(0x7f61941019a0 msgr2=0x7f61941026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 shutdown_connections 2024-09-19T08:36:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:07.670+0000 7f619bbfb640 1 -- 172.21.15.18:0/1548877279 wait complete. 2024-09-19T08:36:08.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:08 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:08.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:08 smithi018 ceph-mon[30956]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:08.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:08 smithi018 ceph-mon[30956]: Saving service mgr spec with placement count:2 2024-09-19T08:36:08.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:08 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:10.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.664+0000 7efc06cd3640 1 Processor -- start 2024-09-19T08:36:10.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.664+0000 7efc06cd3640 1 -- start start 2024-09-19T08:36:10.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.665+0000 7efc06cd3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0007b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:10.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.665+0000 7efc06cd3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc0007b760 con 0x7efc0007cd30 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.665+0000 7efc04a6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0007b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.665+0000 7efc04a6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0007b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58186/0 (socket says 172.21.15.18:58186) 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.665+0000 7efc04a6f640 1 -- 172.21.15.18:0/2843446804 learned_addr learned my addr 172.21.15.18:0/2843446804 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.665+0000 7efc04a6f640 1 -- 172.21.15.18:0/2843446804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0007b8e0 con 0x7efc0007cd30 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.666+0000 7efc04a6f640 1 --2- 172.21.15.18:0/2843446804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0007b190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009820 tx=0x7efbf402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0e5c31ff581229 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.666+0000 7efbff7fe640 1 -- 172.21.15.18:0/2843446804 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4037070 con 0x7efc0007cd30 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.666+0000 7efbff7fe640 1 -- 172.21.15.18:0/2843446804 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efbf40328f0 con 0x7efc0007cd30 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.666+0000 7efbff7fe640 1 -- 172.21.15.18:0/2843446804 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4030740 con 0x7efc0007cd30 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- 172.21.15.18:0/2843446804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 msgr2=0x7efc0007b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 --2- 172.21.15.18:0/2843446804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0007b190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009820 tx=0x7efbf402a270 comp rx=0 tx=0).stop 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- 172.21.15.18:0/2843446804 shutdown_connections 2024-09-19T08:36:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 --2- 172.21.15.18:0/2843446804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0007b190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- 172.21.15.18:0/2843446804 >> 172.21.15.18:0/2843446804 conn(0x7efc00102a70 msgr2=0x7efc00104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- 172.21.15.18:0/2843446804 shutdown_connections 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- 172.21.15.18:0/2843446804 wait complete. 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 Processor -- start 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- start start 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.667+0000 7efc06cd3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc0010d990 con 0x7efc0007cd30 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc04a6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc04a6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58190/0 (socket says 172.21.15.18:58190) 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc04a6f640 1 -- 172.21.15.18:0/4181635057 learned_addr learned my addr 172.21.15.18:0/4181635057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc04a6f640 1 -- 172.21.15.18:0/4181635057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0019dcf0 con 0x7efc0007cd30 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc04a6f640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0019d7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efbf4030cc0 tx=0x7efbf4030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4042070 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efbf4030e60 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0019df80 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4037040 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.668+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc001a0c70 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.669+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7efbf4045070 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.669+0000 7efbfdffb640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7efbf0039200 0x7efbf003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.669+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efbf406c310 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.669+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0007b210 con 0x7efc0007cd30 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.670+0000 7efbfffff640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7efbf0039200 0x7efbf003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.670+0000 7efbfffff640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7efbf0039200 0x7efbf003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efbec0098c0 tx=0x7efbec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:10.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.674+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efbf404b170 con 0x7efc0007cd30 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.857+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7efc0002d7c0 con 0x7efc0007cd30 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.859+0000 7efbfdffb640 1 -- 172.21.15.18:0/4181635057 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7efbf402fd90 con 0x7efc0007cd30 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7efbf0039200 msgr2=0x7efbf003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7efbf0039200 0x7efbf003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efbec0098c0 tx=0x7efbec006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 msgr2=0x7efc0019d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0019d7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efbf4030cc0 tx=0x7efbf4030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 shutdown_connections 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7efbf0039200 0x7efbf003b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 --2- 172.21.15.18:0/4181635057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc0007cd30 0x7efc0019d7b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.862+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 >> 172.21.15.18:0/4181635057 conn(0x7efc00102a70 msgr2=0x7efc00103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.863+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 shutdown_connections 2024-09-19T08:36:10.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:08.863+0000 7efc06cd3640 1 -- 172.21.15.18:0/4181635057 wait complete. 2024-09-19T08:36:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:09 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4181635057' entity='client.admin' 2024-09-19T08:36:10.122 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:09 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:11.348 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.545+0000 7f4b1bbad640 1 Processor -- start 2024-09-19T08:36:11.348 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.546+0000 7f4b1bbad640 1 -- start start 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.546+0000 7f4b1bbad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b14108e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.546+0000 7f4b1bbad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b14107040 con 0x7f4b14108a60 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.546+0000 7f4b19949640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b14108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.546+0000 7f4b19949640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b14108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59868/0 (socket says 172.21.15.18:59868) 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.546+0000 7f4b19949640 1 -- 172.21.15.18:0/3142327624 learned_addr learned my addr 172.21.15.18:0/3142327624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.547+0000 7f4b19949640 1 -- 172.21.15.18:0/3142327624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b141071c0 con 0x7f4b14108a60 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.547+0000 7f4b19949640 1 --2- 172.21.15.18:0/3142327624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b14108e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009820 tx=0x7f4b1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aacc3dabe2b2253 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b18947640 1 -- 172.21.15.18:0/3142327624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10037070 con 0x7f4b14108a60 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b18947640 1 -- 172.21.15.18:0/3142327624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b100328f0 con 0x7f4b14108a60 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b18947640 1 -- 172.21.15.18:0/3142327624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10030740 con 0x7f4b14108a60 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 -- 172.21.15.18:0/3142327624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 msgr2=0x7f4b14108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 --2- 172.21.15.18:0/3142327624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b14108e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009820 tx=0x7f4b1002a270 comp rx=0 tx=0).stop 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 -- 172.21.15.18:0/3142327624 shutdown_connections 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 --2- 172.21.15.18:0/3142327624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b14108e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 -- 172.21.15.18:0/3142327624 >> 172.21.15.18:0/3142327624 conn(0x7f4b14102b70 msgr2=0x7f4b14104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 -- 172.21.15.18:0/3142327624 shutdown_connections 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.548+0000 7f4b1bbad640 1 -- 172.21.15.18:0/3142327624 wait complete. 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b1bbad640 1 Processor -- start 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b1bbad640 1 -- start start 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b1bbad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b1419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b1bbad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1410b930 con 0x7f4b14108a60 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b19949640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b1419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b19949640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b1419b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59872/0 (socket says 172.21.15.18:59872) 2024-09-19T08:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b19949640 1 -- 172.21.15.18:0/1519579530 learned_addr learned my addr 172.21.15.18:0/1519579530 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.549+0000 7f4b19949640 1 -- 172.21.15.18:0/1519579530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1419bc50 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.550+0000 7f4b19949640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b1419b710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009940 tx=0x7f4b10030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.550+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10042070 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.550+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b10030e30 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.550+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1419bee0 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.550+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10037040 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.550+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1419ebd0 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.551+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4b10045070 con 0x7f4b14108a60 2024-09-19T08:36:11.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.551+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b14108ee0 con 0x7f4b14108a60 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.551+0000 7f4b0affd640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f4b000391b0 0x7f4b0003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.551+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b1006c310 con 0x7f4b14108a60 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.551+0000 7f4b19148640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f4b000391b0 0x7f4b0003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.551+0000 7f4b19148640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f4b000391b0 0x7f4b0003b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b040098c0 tx=0x7f4b04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.556+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b1002fd90 con 0x7f4b14108a60 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.733+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f4b14068690 con 0x7f4b14108a60 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.736+0000 7f4b0affd640 1 -- 172.21.15.18:0/1519579530 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4b1003d950 con 0x7f4b14108a60 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f4b000391b0 msgr2=0x7f4b0003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f4b000391b0 0x7f4b0003b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b040098c0 tx=0x7f4b04006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 msgr2=0x7f4b1419b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:11.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b1419b710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009940 tx=0x7f4b10030cc0 comp rx=0 tx=0).stop 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 shutdown_connections 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7f4b000391b0 0x7f4b0003b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 --2- 172.21.15.18:0/1519579530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14108a60 0x7f4b1419b710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 >> 172.21.15.18:0/1519579530 conn(0x7f4b14102b70 msgr2=0x7f4b14103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 shutdown_connections 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:10.739+0000 7f4b1bbad640 1 -- 172.21.15.18:0/1519579530 wait complete. 2024-09-19T08:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling the dashboard module... 2024-09-19T08:36:11.742 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:11 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2333766229' entity='mgr.x' 2024-09-19T08:36:11.742 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:11 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1519579530' entity='client.admin' 2024-09-19T08:36:12.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:12 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/606700367' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:36:12.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:12 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setuser ceph since I am not root 2024-09-19T08:36:12.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:12 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setgroup ceph since I am not root 2024-09-19T08:36:12.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:12 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:12.786+0000 7fda56285040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:36:12.944 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:12 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:12.846+0000 7fda56285040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:13.310 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.002+0000 7fda56285040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:36:13.310 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.071+0000 7fda56285040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:36:13.310 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.229+0000 7fda56285040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:13.585 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.378+0000 7fda56285040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:36:13.588 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.746+0000 7fac88ce0640 1 Processor -- start 2024-09-19T08:36:13.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.747+0000 7fac88ce0640 1 -- start start 2024-09-19T08:36:13.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.747+0000 7fac88ce0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8410a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:13.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.747+0000 7fac88ce0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac840757a0 con 0x7fac84107dc0 2024-09-19T08:36:13.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.747+0000 7fac8259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8410a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:13.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.747+0000 7fac8259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8410a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59882/0 (socket says 172.21.15.18:59882) 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.747+0000 7fac8259c640 1 -- 172.21.15.18:0/1568038244 learned_addr learned my addr 172.21.15.18:0/1568038244 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.748+0000 7fac8259c640 1 -- 172.21.15.18:0/1568038244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8410a6f0 con 0x7fac84107dc0 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.748+0000 7fac8259c640 1 --2- 172.21.15.18:0/1568038244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8410a1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac74009820 tx=0x7fac7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c95bb2f8248372 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.748+0000 7fac8159a640 1 -- 172.21.15.18:0/1568038244 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac74037070 con 0x7fac84107dc0 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac8159a640 1 -- 172.21.15.18:0/1568038244 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac740328f0 con 0x7fac84107dc0 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac8159a640 1 -- 172.21.15.18:0/1568038244 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac74030740 con 0x7fac84107dc0 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 -- 172.21.15.18:0/1568038244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 msgr2=0x7fac8410a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:13.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 --2- 172.21.15.18:0/1568038244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8410a1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac74009820 tx=0x7fac7402a270 comp rx=0 tx=0).stop 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 -- 172.21.15.18:0/1568038244 shutdown_connections 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 --2- 172.21.15.18:0/1568038244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8410a1b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 -- 172.21.15.18:0/1568038244 >> 172.21.15.18:0/1568038244 conn(0x7fac841019a0 msgr2=0x7fac84103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 -- 172.21.15.18:0/1568038244 shutdown_connections 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.749+0000 7fac88ce0640 1 -- 172.21.15.18:0/1568038244 wait complete. 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac88ce0640 1 Processor -- start 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac88ce0640 1 -- start start 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac88ce0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac88ce0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac8410b770 con 0x7fac84107dc0 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac8259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac8259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59898/0 (socket says 172.21.15.18:59898) 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.750+0000 7fac8259c640 1 -- 172.21.15.18:0/606700367 learned_addr learned my addr 172.21.15.18:0/606700367 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac8259c640 1 -- 172.21.15.18:0/606700367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8419bb20 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac8259c640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8419b5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac740097f0 tx=0x7fac74030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac74042070 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac74030d80 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8419bdb0 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac74037040 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.751+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8419eaa0 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.752+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fac74045070 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.752+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84108220 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.752+0000 7fac7b7fe640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fac70039200 0x7fac7003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.752+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fac7406c350 con 0x7fac84107dc0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.752+0000 7fac81d9b640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fac70039200 0x7fac7003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.753+0000 7fac81d9b640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fac70039200 0x7fac7003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0098c0 tx=0x7fac6c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:13.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.757+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac7403ce40 con 0x7fac84107dc0 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:11.983+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fac8402d7c0 con 0x7fac84107dc0 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.623+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fac74045520 con 0x7fac84107dc0 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.625+0000 7fac7b7fe640 1 -- 172.21.15.18:0/606700367 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fac7403c660 con 0x7fac84107dc0 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.626+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fac70039200 msgr2=0x7fac7003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.626+0000 7fac88ce0640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fac70039200 0x7fac7003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0098c0 tx=0x7fac6c006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.626+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 msgr2=0x7fac8419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.626+0000 7fac88ce0640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8419b5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac740097f0 tx=0x7fac74030c70 comp rx=0 tx=0).stop 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.627+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 shutdown_connections 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.627+0000 7fac88ce0640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fac70039200 0x7fac7003b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.627+0000 7fac88ce0640 1 --2- 172.21.15.18:0/606700367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac84107dc0 0x7fac8419b5e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.627+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 >> 172.21.15.18:0/606700367 conn(0x7fac841019a0 msgr2=0x7fac841026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.627+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 shutdown_connections 2024-09-19T08:36:13.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:12.627+0000 7fac88ce0640 1 -- 172.21.15.18:0/606700367 wait complete. 2024-09-19T08:36:13.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/606700367' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:36:13.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-mon[30956]: mgrmap e9: x(active, since 19s) 2024-09-19T08:36:13.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.715+0000 7fda56285040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:36:13.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.781+0000 7fda56285040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:36:14.193 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:13.980+0000 7fda56285040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:36:14.809 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68c280640 1 Processor -- start 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68c280640 1 -- start start 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68c280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68410a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68c280640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6840757a0 con 0x7fe684107dc0 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68a01c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68410a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68a01c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68410a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59936/0 (socket says 172.21.15.18:59936) 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68a01c640 1 -- 172.21.15.18:0/2749392776 learned_addr learned my addr 172.21.15.18:0/2749392776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:14.810 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.028+0000 7fe68a01c640 1 -- 172.21.15.18:0/2749392776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68410a6f0 con 0x7fe684107dc0 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.030+0000 7fe68a01c640 1 --2- 172.21.15.18:0/2749392776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68410a1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe680009820 tx=0x7fe68002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806217b0ce7c79c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.030+0000 7fe68901a640 1 -- 172.21.15.18:0/2749392776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680037070 con 0x7fe684107dc0 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.030+0000 7fe68901a640 1 -- 172.21.15.18:0/2749392776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6800328f0 con 0x7fe684107dc0 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.030+0000 7fe68901a640 1 -- 172.21.15.18:0/2749392776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680030740 con 0x7fe684107dc0 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.030+0000 7fe68c280640 1 -- 172.21.15.18:0/2749392776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 msgr2=0x7fe68410a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.030+0000 7fe68c280640 1 --2- 172.21.15.18:0/2749392776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68410a1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe680009820 tx=0x7fe68002a270 comp rx=0 tx=0).stop 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.031+0000 7fe68c280640 1 -- 172.21.15.18:0/2749392776 shutdown_connections 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.031+0000 7fe68c280640 1 --2- 172.21.15.18:0/2749392776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68410a1b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.031+0000 7fe68c280640 1 -- 172.21.15.18:0/2749392776 >> 172.21.15.18:0/2749392776 conn(0x7fe6841019a0 msgr2=0x7fe684103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.031+0000 7fe68c280640 1 -- 172.21.15.18:0/2749392776 shutdown_connections 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.031+0000 7fe68c280640 1 -- 172.21.15.18:0/2749392776 wait complete. 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68c280640 1 Processor -- start 2024-09-19T08:36:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68c280640 1 -- start start 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68c280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68c280640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe68410b770 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68a01c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68a01c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59946/0 (socket says 172.21.15.18:59946) 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68a01c640 1 -- 172.21.15.18:0/2182051665 learned_addr learned my addr 172.21.15.18:0/2182051665 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68a01c640 1 -- 172.21.15.18:0/2182051665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68419bb20 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.032+0000 7fe68a01c640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68419b5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe680030cc0 tx=0x7fe680030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.033+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680042070 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.033+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe680030e60 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.033+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68419bdb0 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.033+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680037040 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.033+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68419eaa0 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.034+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fe680045070 con 0x7fe684107dc0 2024-09-19T08:36:14.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.034+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe684108220 con 0x7fe684107dc0 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.034+0000 7fe67b7fe640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 0x7fe67003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.034+0000 7fe68981b640 1 -- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 msgr2=0x7fe67003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4188004415 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.034+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe68006d2c0 con 0x7fe684107dc0 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.034+0000 7fe68981b640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 0x7fe67003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.039+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe680045360 con 0x7fe684107dc0 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.235+0000 7fe68981b640 1 -- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 msgr2=0x7fe67003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4188004415 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.235+0000 7fe68981b640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 0x7fe67003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.263+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe68402d7c0 con 0x7fe684107dc0 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.264+0000 7fe67b7fe640 1 -- 172.21.15.18:0/2182051665 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe68003ad90 con 0x7fe684107dc0 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 msgr2=0x7fe67003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:14.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 0x7fe67003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 msgr2=0x7fe68419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68419b5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe680030cc0 tx=0x7fe680030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 shutdown_connections 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7fe670039200 0x7fe67003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 --2- 172.21.15.18:0/2182051665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684107dc0 0x7fe68419b5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 >> 172.21.15.18:0/2182051665 conn(0x7fe6841019a0 msgr2=0x7fe6841026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 shutdown_connections 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:14.267+0000 7fe68c280640 1 -- 172.21.15.18:0/2182051665 wait complete. 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-19T08:36:14.814 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 9... 2024-09-19T08:36:14.928 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:14 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2182051665' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:36:15.194 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:14 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:14.930+0000 7fda56285040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:36:15.194 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:15 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:15.002+0000 7fda56285040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:36:16.034 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:15 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:15.761+0000 7fda56285040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:36:16.034 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:15 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:15.883+0000 7fda56285040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:36:16.326 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.033+0000 7fda56285040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:16.326 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.097+0000 7fda56285040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:36:16.326 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.253+0000 7fda56285040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:36:16.326 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.325+0000 7fda56285040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:36:16.623 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.388+0000 7fda56285040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:36:16.624 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.555+0000 7fda56285040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:36:16.624 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.623+0000 7fda56285040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:36:16.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.693+0000 7fda56285040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:36:16.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.780+0000 7fda56285040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:16.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.842+0000 7fda56285040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:36:16.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:16.904+0000 7fda56285040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:36:17.976 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:17.760+0000 7fda56285040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:36:17.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T08:36:17.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: Activating manager daemon x 2024-09-19T08:36:17.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:36:17.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: mgrmap e10: x(active, starting, since 0.00336703s) 2024-09-19T08:36:17.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:36:17.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:36:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:36:19.901 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:36:19.901 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:36:19.901 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:36:19.901 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.240+0000 7faf3f992640 1 Processor -- start 2024-09-19T08:36:19.901 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3f992640 1 -- start start 2024-09-19T08:36:19.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3f992640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3810a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:19.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3f992640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf38075720 con 0x7faf38107e50 2024-09-19T08:36:19.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3d72e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3810a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:19.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3d72e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3810a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59958/0 (socket says 172.21.15.18:59958) 2024-09-19T08:36:19.908 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3d72e640 1 -- 172.21.15.18:0/1807440774 learned_addr learned my addr 172.21.15.18:0/1807440774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:19.908 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.241+0000 7faf3d72e640 1 -- 172.21.15.18:0/1807440774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3810a780 con 0x7faf38107e50 2024-09-19T08:36:19.908 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.242+0000 7faf3d72e640 1 --2- 172.21.15.18:0/1807440774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3810a240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf34009820 tx=0x7faf3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d81f6cf48f8b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:19.908 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.242+0000 7faf2ffff640 1 -- 172.21.15.18:0/1807440774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34037070 con 0x7faf38107e50 2024-09-19T08:36:19.908 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.242+0000 7faf2ffff640 1 -- 172.21.15.18:0/1807440774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf340328f0 con 0x7faf38107e50 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.242+0000 7faf2ffff640 1 -- 172.21.15.18:0/1807440774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34030740 con 0x7faf38107e50 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 -- 172.21.15.18:0/1807440774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 msgr2=0x7faf3810a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 --2- 172.21.15.18:0/1807440774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3810a240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf34009820 tx=0x7faf3402a270 comp rx=0 tx=0).stop 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 -- 172.21.15.18:0/1807440774 shutdown_connections 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 --2- 172.21.15.18:0/1807440774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3810a240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 -- 172.21.15.18:0/1807440774 >> 172.21.15.18:0/1807440774 conn(0x7faf381019b0 msgr2=0x7faf38103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 -- 172.21.15.18:0/1807440774 shutdown_connections 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.243+0000 7faf3f992640 1 -- 172.21.15.18:0/1807440774 wait complete. 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.244+0000 7faf3f992640 1 Processor -- start 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.244+0000 7faf3f992640 1 -- start start 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.244+0000 7faf3f992640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:19.909 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.244+0000 7faf3f992640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf3810b740 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3d72e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3d72e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59966/0 (socket says 172.21.15.18:59966) 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3d72e640 1 -- 172.21.15.18:0/3883156663 learned_addr learned my addr 172.21.15.18:0/3883156663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3d72e640 1 -- 172.21.15.18:0/3883156663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3819bbb0 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3d72e640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3819b670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf34030cc0 tx=0x7faf34030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34042070 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf34030e60 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3819be40 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34037040 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.245+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3819eb30 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.246+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7faf34045070 con 0x7faf38107e50 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.246+0000 7faf2e7fc640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:19.910 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.246+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 --> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faf2403bdd0 con 0x7faf24039200 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.247+0000 7faf3cf2d640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 msgr2=0x7faf2403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4188004415 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.247+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faf3406c5d0 con 0x7faf38107e50 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.247+0000 7faf3cf2d640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.448+0000 7faf3cf2d640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 msgr2=0x7faf2403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4188004415 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.448+0000 7faf3cf2d640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.849+0000 7faf3cf2d640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 msgr2=0x7faf2403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4188004415 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:15.849+0000 7faf3cf2d640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:16.650+0000 7faf3cf2d640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 msgr2=0x7faf2403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4188004415 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:16.650+0000 7faf3cf2d640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:17.763+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7faf3406b080 con 0x7faf38107e50 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:17.763+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 msgr2=0x7faf2403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:17.763+0000 7faf2e7fc640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.765+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7faf3403cc10 con 0x7faf38107e50 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.765+0000 7faf2e7fc640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faf2403ccc0 0x7faf2403f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.765+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faf34034ec0 con 0x7faf2403ccc0 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.765+0000 7faf3cf2d640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faf2403ccc0 0x7faf2403f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.766+0000 7faf3cf2d640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faf2403ccc0 0x7faf2403f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faf28003980 tx=0x7faf28006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.767+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7faf34034ec0 con 0x7faf2403ccc0 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7faf381082b0 con 0x7faf2403ccc0 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf2e7fc640 1 -- 172.21.15.18:0/3883156663 <== mgr.14150 v2:172.21.15.18:6800/2747026181 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7faf381082b0 con 0x7faf2403ccc0 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faf2403ccc0 msgr2=0x7faf2403f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faf2403ccc0 0x7faf2403f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faf28003980 tx=0x7faf28006e10 comp rx=0 tx=0).stop 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 msgr2=0x7faf3819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3819b670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf34030cc0 tx=0x7faf34030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 shutdown_connections 2024-09-19T08:36:19.912 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faf2403ccc0 0x7faf2403f0b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:6800/4188004415,v1:172.21.15.18:6801/4188004415] conn(0x7faf24039200 0x7faf2403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 --2- 172.21.15.18:0/3883156663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf38107e50 0x7faf3819b670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 >> 172.21.15.18:0/3883156663 conn(0x7faf381019b0 msgr2=0x7faf38102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 shutdown_connections 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:18.774+0000 7faf3f992640 1 -- 172.21.15.18:0/3883156663 wait complete. 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 9 is available 2024-09-19T08:36:19.913 INFO:teuthology.orchestra.run.smithi018.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:36:19.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:19 smithi018 ceph-mon[30956]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:36:19.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:19 smithi018 ceph-mon[30956]: mgrmap e11: x(active, since 1.00592s) 2024-09-19T08:36:19.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:19 smithi018 ceph-mon[30956]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:36:19.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:19.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:20.074+0000 7fd9bbd0e640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:36:20] ENGINE Error in HTTPServer.serve 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: Traceback (most recent call last): 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self._connections.run(self.expiration_interval) 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self._run(expiration_interval) 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:36:20.323 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: s = self.context.wrap_socket( 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: return self.sslsocket_class._create( 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self.do_handshake() 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: self._sslobj.do_handshake() 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:36:20.324 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:36:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:36:21.414 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:36:21.414 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.175+0000 7f5447f0a640 1 Processor -- start 2024-09-19T08:36:21.414 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.175+0000 7f5447f0a640 1 -- start start 2024-09-19T08:36:21.414 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.176+0000 7f5447f0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544007c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.176+0000 7f5447f0a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f544007c870 con 0x7f544007de40 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.176+0000 7f5445ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544007c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.176+0000 7f5445ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544007c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47092/0 (socket says 172.21.15.18:47092) 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.176+0000 7f5445ca6640 1 -- 172.21.15.18:0/2814125635 learned_addr learned my addr 172.21.15.18:0/2814125635 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.176+0000 7f5445ca6640 1 -- 172.21.15.18:0/2814125635 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544007c9f0 con 0x7f544007de40 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.177+0000 7f5445ca6640 1 --2- 172.21.15.18:0/2814125635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544007c2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f543c009820 tx=0x7f543c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e04b28834d24fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.177+0000 7f5444ca4640 1 -- 172.21.15.18:0/2814125635 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c037070 con 0x7f544007de40 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.177+0000 7f5444ca4640 1 -- 172.21.15.18:0/2814125635 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f543c0328f0 con 0x7f544007de40 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.177+0000 7f5444ca4640 1 -- 172.21.15.18:0/2814125635 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c030740 con 0x7f544007de40 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.177+0000 7f5447f0a640 1 -- 172.21.15.18:0/2814125635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 msgr2=0x7f544007c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.177+0000 7f5447f0a640 1 --2- 172.21.15.18:0/2814125635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544007c2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f543c009820 tx=0x7f543c02a270 comp rx=0 tx=0).stop 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 -- 172.21.15.18:0/2814125635 shutdown_connections 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 --2- 172.21.15.18:0/2814125635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544007c2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 -- 172.21.15.18:0/2814125635 >> 172.21.15.18:0/2814125635 conn(0x7f5440102b10 msgr2=0x7f5440104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 -- 172.21.15.18:0/2814125635 shutdown_connections 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 -- 172.21.15.18:0/2814125635 wait complete. 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 Processor -- start 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 -- start start 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544019d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:21.416 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.178+0000 7f5447f0a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f544010d9f0 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5445ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544019d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5445ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544019d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47094/0 (socket says 172.21.15.18:47094) 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5445ca6640 1 -- 172.21.15.18:0/1808697111 learned_addr learned my addr 172.21.15.18:0/1808697111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5445ca6640 1 -- 172.21.15.18:0/1808697111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544019dd70 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5445ca6640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544019d830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f543c030cc0 tx=0x7f543c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c042070 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544019e000 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f543c030e60 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401a0cf0 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.179+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c037040 con 0x7f544007de40 2024-09-19T08:36:21.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.180+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f543c045070 con 0x7f544007de40 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.181+0000 7f5436ffd640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f542c0390f0 0x7f542c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.181+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544007c320 con 0x7f544007de40 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.181+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f543c06c280 con 0x7f544007de40 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.181+0000 7f54454a5640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f542c0390f0 0x7f542c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.181+0000 7f54454a5640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f542c0390f0 0x7f542c03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54300098c0 tx=0x7f5430006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.187+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f543c04b170 con 0x7f544007de40 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.375+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f5440062630 con 0x7f542c0390f0 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.468+0000 7f5436ffd640 1 -- 172.21.15.18:0/1808697111 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f5440062630 con 0x7f542c0390f0 2024-09-19T08:36:21.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f542c0390f0 msgr2=0x7f542c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f542c0390f0 0x7f542c03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54300098c0 tx=0x7f5430006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 msgr2=0x7f544019d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544019d830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f543c030cc0 tx=0x7f543c030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 shutdown_connections 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f542c0390f0 0x7f542c03b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 --2- 172.21.15.18:0/1808697111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f544007de40 0x7f544019d830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 >> 172.21.15.18:0/1808697111 conn(0x7f5440102b10 msgr2=0x7f54401037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 shutdown_connections 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:20.470+0000 7f5447f0a640 1 -- 172.21.15.18:0/1808697111 wait complete. 2024-09-19T08:36:21.419 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial admin user... 2024-09-19T08:36:21.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: [19/Sep/2024:08:36:19] ENGINE Bus STARTING 2024-09-19T08:36:21.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: [19/Sep/2024:08:36:19] ENGINE Serving on http://172.21.15.18:8765 2024-09-19T08:36:21.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: [19/Sep/2024:08:36:20] ENGINE Serving on https://172.21.15.18:7150 2024-09-19T08:36:21.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: [19/Sep/2024:08:36:20] ENGINE Bus STARTED 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: [19/Sep/2024:08:36:20] ENGINE Error in HTTPServer.serve 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-19T08:36:21.783 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:21.784 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:21 smithi018 ceph-mon[30956]: mgrmap e12: x(active, since 2s) 2024-09-19T08:36:23.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:22 smithi018 ceph-mon[30956]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:23.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:23.389 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$9lv1nnybKjrxqHJqi6efleRdWlpNQgGV52oVtzH9BDmkT7i5L2oUS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726734982, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:36:23.389 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05aaee7640 1 Processor -- start 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05aaee7640 1 -- start start 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05aaee7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05aaee7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05a407c850 con 0x7f05a407de20 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05a8c83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05a8c83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47096/0 (socket says 172.21.15.18:47096) 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05a8c83640 1 -- 172.21.15.18:0/1945815565 learned_addr learned my addr 172.21.15.18:0/1945815565 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.278+0000 7f05a8c83640 1 -- 172.21.15.18:0/1945815565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a407c9d0 con 0x7f05a407de20 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.279+0000 7f05a8c83640 1 --2- 172.21.15.18:0/1945815565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a407c280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f058c009820 tx=0x7f058c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befc3b87c7629e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.279+0000 7f05a37fe640 1 -- 172.21.15.18:0/1945815565 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f058c037070 con 0x7f05a407de20 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05a37fe640 1 -- 172.21.15.18:0/1945815565 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f058c0328f0 con 0x7f05a407de20 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05a37fe640 1 -- 172.21.15.18:0/1945815565 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f058c030740 con 0x7f05a407de20 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 -- 172.21.15.18:0/1945815565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 msgr2=0x7f05a407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:23.390 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 --2- 172.21.15.18:0/1945815565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a407c280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f058c009820 tx=0x7f058c02a270 comp rx=0 tx=0).stop 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 -- 172.21.15.18:0/1945815565 shutdown_connections 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 --2- 172.21.15.18:0/1945815565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a407c280 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 -- 172.21.15.18:0/1945815565 >> 172.21.15.18:0/1945815565 conn(0x7f05a4102b10 msgr2=0x7f05a4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 -- 172.21.15.18:0/1945815565 shutdown_connections 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.280+0000 7f05aaee7640 1 -- 172.21.15.18:0/1945815565 wait complete. 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05aaee7640 1 Processor -- start 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05aaee7640 1 -- start start 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05aaee7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05aaee7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410d9b0 con 0x7f05a407de20 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05a8c83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05a8c83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47108/0 (socket says 172.21.15.18:47108) 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.281+0000 7f05a8c83640 1 -- 172.21.15.18:0/2334616736 learned_addr learned my addr 172.21.15.18:0/2334616736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05a8c83640 1 -- 172.21.15.18:0/2334616736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a419dd00 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05a8c83640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a419d7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f058c030cc0 tx=0x7f058c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f058c042070 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f058c030e60 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a419df90 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f058c037040 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.282+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a41a0c80 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.283+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f058c045070 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.283+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a407c300 con 0x7f05a407de20 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.283+0000 7f05a1ffb640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0590039260 0x7f059003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:23.392 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.284+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f058c06c5b0 con 0x7f05a407de20 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.284+0000 7f05a3fff640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0590039260 0x7f059003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.284+0000 7f05a3fff640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0590039260 0x7f059003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f059400ad30 tx=0x7f05940093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.288+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f058c03ac60 con 0x7f05a407de20 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.479+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f05a4103e90 con 0x7f0590039260 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.727+0000 7f05a1ffb640 1 -- 172.21.15.18:0/2334616736 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f05a4103e90 con 0x7f0590039260 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0590039260 msgr2=0x7f059003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0590039260 0x7f059003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f059400ad30 tx=0x7f05940093f0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 msgr2=0x7f05a419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:23.393 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a419d7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f058c030cc0 tx=0x7f058c030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 shutdown_connections 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0590039260 0x7f059003b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 --2- 172.21.15.18:0/2334616736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a407de20 0x7f05a419d7c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 >> 172.21.15.18:0/2334616736 conn(0x7f05a4102b10 msgr2=0x7f05a4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 shutdown_connections 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:22.729+0000 7f05aaee7640 1 -- 172.21.15.18:0/2334616736 wait complete. 2024-09-19T08:36:23.394 INFO:teuthology.orchestra.run.smithi018.stdout:Fetching dashboard port number... 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.769+0000 7f3e1ad3b640 1 Processor -- start 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e1ad3b640 1 -- start start 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e1ad3b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1410a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e1ad3b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140756c0 con 0x7f3e14107ea0 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e18ad7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1410a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e18ad7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1410a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47120/0 (socket says 172.21.15.18:47120) 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e18ad7640 1 -- 172.21.15.18:0/4072903830 learned_addr learned my addr 172.21.15.18:0/4072903830 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.770+0000 7f3e18ad7640 1 -- 172.21.15.18:0/4072903830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1410a7d0 con 0x7f3e14107ea0 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.771+0000 7f3e18ad7640 1 --2- 172.21.15.18:0/4072903830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1410a290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009820 tx=0x7f3e0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34f688a9776705d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.771+0000 7f3e137fe640 1 -- 172.21.15.18:0/4072903830 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c037070 con 0x7f3e14107ea0 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.771+0000 7f3e137fe640 1 -- 172.21.15.18:0/4072903830 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e0c0328f0 con 0x7f3e14107ea0 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.771+0000 7f3e137fe640 1 -- 172.21.15.18:0/4072903830 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c030740 con 0x7f3e14107ea0 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/4072903830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 msgr2=0x7f3e1410a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 --2- 172.21.15.18:0/4072903830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1410a290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009820 tx=0x7f3e0c02a270 comp rx=0 tx=0).stop 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/4072903830 shutdown_connections 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 --2- 172.21.15.18:0/4072903830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1410a290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/4072903830 >> 172.21.15.18:0/4072903830 conn(0x7f3e141019a0 msgr2=0x7f3e14103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/4072903830 shutdown_connections 2024-09-19T08:36:24.544 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.772+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/4072903830 wait complete. 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e1ad3b640 1 Processor -- start 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e1ad3b640 1 -- start start 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e1ad3b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e1ad3b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1410b730 con 0x7f3e14107ea0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e18ad7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e18ad7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1419b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47132/0 (socket says 172.21.15.18:47132) 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e18ad7640 1 -- 172.21.15.18:0/1057432568 learned_addr learned my addr 172.21.15.18:0/1057432568 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.773+0000 7f3e18ad7640 1 -- 172.21.15.18:0/1057432568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1419bb80 con 0x7f3e14107ea0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.774+0000 7f3e18ad7640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1419b640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c030cc0 tx=0x7f3e0c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.774+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c042070 con 0x7f3e14107ea0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.774+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e0c030e60 con 0x7f3e14107ea0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.774+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1419be10 con 0x7f3e14107ea0 2024-09-19T08:36:24.545 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.774+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c037040 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.774+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1419eab0 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.775+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3e0c045070 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.775+0000 7f3e11ffb640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3e00039260 0x7f3e0003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.775+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14108300 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.775+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3e0c06c450 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.775+0000 7f3e13fff640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3e00039260 0x7f3e0003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.776+0000 7f3e13fff640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3e00039260 0x7f3e0003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400ad30 tx=0x7f3e040093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.780+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e0c04b170 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.815+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3e0c03d950 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.956+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f3e1402d7c0 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.957+0000 7f3e11ffb640 1 -- 172.21.15.18:0/1057432568 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f3e0c0392e0 con 0x7f3e14107ea0 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3e00039260 msgr2=0x7f3e0003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:24.546 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3e00039260 0x7f3e0003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400ad30 tx=0x7f3e040093f0 comp rx=0 tx=0).stop 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 msgr2=0x7f3e1419b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1419b640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c030cc0 tx=0x7f3e0c030cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 shutdown_connections 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3e00039260 0x7f3e0003b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 --2- 172.21.15.18:0/1057432568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e14107ea0 0x7f3e1419b640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 >> 172.21.15.18:0/1057432568 conn(0x7f3e141019a0 msgr2=0x7f3e14102750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 shutdown_connections 2024-09-19T08:36:24.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:23.959+0000 7f3e1ad3b640 1 -- 172.21.15.18:0/1057432568 wait complete. 2024-09-19T08:36:24.551 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:36:24.551 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T08:36:24.559 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:36:24.559 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T08:36:24.559 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T08:36:24.560 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph Dashboard is now available at: 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout: URL: https://smithi018.front.sepia.ceph.com:8443/ 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout: User: admin 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout: Password: yrq689h2i7 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:24.562 INFO:teuthology.orchestra.run.smithi018.stdout:Saving cluster configuration to /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config directory 2024-09-19T08:36:25.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:24 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 6s) 2024-09-19T08:36:25.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1057432568' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:36:25.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.988+0000 7fa1801f0640 1 Processor -- start 2024-09-19T08:36:25.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa1801f0640 1 -- start start 2024-09-19T08:36:25.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa1801f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa178108e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:25.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa1801f0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa178107040 con 0x7fa178108a60 2024-09-19T08:36:25.902 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa17df8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa178108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa17df8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa178108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47134/0 (socket says 172.21.15.18:47134) 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa17df8c640 1 -- 172.21.15.18:0/3472160976 learned_addr learned my addr 172.21.15.18:0/3472160976 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.989+0000 7fa17df8c640 1 -- 172.21.15.18:0/3472160976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1781071c0 con 0x7fa178108a60 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.990+0000 7fa17df8c640 1 --2- 172.21.15.18:0/3472160976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa178108e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa174009820 tx=0x7fa17402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a077d0c3b29a298 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.990+0000 7fa17cf8a640 1 -- 172.21.15.18:0/3472160976 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa174037070 con 0x7fa178108a60 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.990+0000 7fa17cf8a640 1 -- 172.21.15.18:0/3472160976 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1740328f0 con 0x7fa178108a60 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.990+0000 7fa17cf8a640 1 -- 172.21.15.18:0/3472160976 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa174030740 con 0x7fa178108a60 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 -- 172.21.15.18:0/3472160976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 msgr2=0x7fa178108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 --2- 172.21.15.18:0/3472160976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa178108e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa174009820 tx=0x7fa17402a270 comp rx=0 tx=0).stop 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 -- 172.21.15.18:0/3472160976 shutdown_connections 2024-09-19T08:36:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 --2- 172.21.15.18:0/3472160976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa178108e60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 -- 172.21.15.18:0/3472160976 >> 172.21.15.18:0/3472160976 conn(0x7fa178102b70 msgr2=0x7fa178104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 -- 172.21.15.18:0/3472160976 shutdown_connections 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.991+0000 7fa1801f0640 1 -- 172.21.15.18:0/3472160976 wait complete. 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa1801f0640 1 Processor -- start 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa1801f0640 1 -- start start 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa1801f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa17807db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa1801f0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa17810b930 con 0x7fa178108a60 2024-09-19T08:36:25.904 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa17df8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa17807db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa17df8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa17807db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47142/0 (socket says 172.21.15.18:47142) 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa17df8c640 1 -- 172.21.15.18:0/1490920115 learned_addr learned my addr 172.21.15.18:0/1490920115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.992+0000 7fa17df8c640 1 -- 172.21.15.18:0/1490920115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17807e050 con 0x7fa178108a60 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.993+0000 7fa17df8c640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa17807db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa174009940 tx=0x7fa174030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.993+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa174042070 con 0x7fa178108a60 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.993+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa174030e30 con 0x7fa178108a60 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.993+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17807c240 con 0x7fa178108a60 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.993+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa174037040 con 0x7fa178108a60 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.993+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17807c780 con 0x7fa178108a60 2024-09-19T08:36:25.905 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.994+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa174045070 con 0x7fa178108a60 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.994+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa178108ee0 con 0x7fa178108a60 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.994+0000 7fa16effd640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa164039300 0x7fa16403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.994+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa17406c4c0 con 0x7fa178108a60 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.994+0000 7fa17d78b640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa164039300 0x7fa16403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.994+0000 7fa17d78b640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa164039300 0x7fa16403b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa1680098c0 tx=0x7fa168006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:24.999+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa17403c650 con 0x7fa178108a60 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.268+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa178194d90 con 0x7fa178108a60 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.270+0000 7fa16effd640 1 -- 172.21.15.18:0/1490920115 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fa17403d950 con 0x7fa178108a60 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:36:25.906 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa164039300 msgr2=0x7fa16403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa164039300 0x7fa16403b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa1680098c0 tx=0x7fa168006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 msgr2=0x7fa17807db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa17807db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa174009940 tx=0x7fa174030cc0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 shutdown_connections 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa164039300 0x7fa16403b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 --2- 172.21.15.18:0/1490920115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa178108a60 0x7fa17807db10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 >> 172.21.15.18:0/1490920115 conn(0x7fa178102b70 msgr2=0x7fa178103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 shutdown_connections 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:25.273+0000 7fa1801f0640 1 -- 172.21.15.18:0/1490920115 wait complete. 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:25.907 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout: ceph telemetry on 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.908 INFO:teuthology.orchestra.run.smithi018.stdout:For more information see: 2024-09-19T08:36:25.909 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.909 INFO:teuthology.orchestra.run.smithi018.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:36:25.909 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:25.909 INFO:teuthology.orchestra.run.smithi018.stdout:Bootstrap complete. 2024-09-19T08:36:25.947 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:36:25.947 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:36:25.947 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:36:25.966 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:36:25.967 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:36:25.967 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:36:26.024 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:36:26.024 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:36:26.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:36:26.092 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:36:26.092 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:36:26.092 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:36:26.149 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:36:26.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:36:26.226 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:26.237 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:36:26.359 INFO:teuthology.orchestra.run.smithi150.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:26.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:36:26.464 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkb3lrlaeGdSoeYu6JWDqFa20ME1em+iSjuO4nFeS5WVfp0tePRjOHO2UxNyQncDoMJmUeYURvTQp9YrTFffW232V2xrAG9LW7c+MFm9AS03ZifUJOh28M6UvRapYBuRraBP4/GAasJGG/4qB8vXLsjLIXwlhSSF1EcKgH7Tff0eNE9VM6Bjkg3xpC5vlB6L1t6mok46S2d/D2KVCGTAhmb0KHzcM1DHZ0tg2THXoVHw5aShDE5PqobcxuI6T9K/SYJvjamwkqPpAE6cPFCPPeUha6KcGs7Thgyn+FCqnyP+QIhuYPPjjStkQML9jxOvbuR12f4KgYPjmINMHaXslOBGmENN5G8ZuMfAW8oC5a7XKedJn+OuWaXKqs+zMpSWeXzQKi/LkN0odYVF/Kdi95TNhx+5fsoDhzzN4tNnhf0UWswKp631s2t1bi+KvUU7ClyjXWQzS1wGNF2q0rQCiLfpO25q/sV0/hyIYeH3HMIXR3o+8WCQhp2PMLHQ7cjYM= ceph-ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:26.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:36:26.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1490920115' entity='client.admin' 2024-09-19T08:36:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:27.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 -- 172.21.15.18:0/3875871707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 msgr2=0x7f9b901044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 --2- 172.21.15.18:0/3875871707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b901044c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009c20 tx=0x7f9b8002aa90 comp rx=0 tx=0).stop 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 -- 172.21.15.18:0/3875871707 shutdown_connections 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 --2- 172.21.15.18:0/3875871707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b901044c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 -- 172.21.15.18:0/3875871707 >> 172.21.15.18:0/3875871707 conn(0x7f9b900fbcd0 msgr2=0x7f9b900fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 -- 172.21.15.18:0/3875871707 shutdown_connections 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.193+0000 7f9b97104640 1 -- 172.21.15.18:0/3875871707 wait complete. 2024-09-19T08:36:27.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b97104640 1 Processor -- start 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b97104640 1 -- start start 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b97104640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b90101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b97104640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90107520 con 0x7f9b901020d0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b94ea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b90101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b94ea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b90101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47162/0 (socket says 172.21.15.18:47162) 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.194+0000 7f9b94ea0640 1 -- 172.21.15.18:0/4052483229 learned_addr learned my addr 172.21.15.18:0/4052483229 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b94ea0640 1 -- 172.21.15.18:0/4052483229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b90101e90 con 0x7f9b901020d0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b94ea0640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b90101950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006010 tx=0x7f9b80030f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80047070 con 0x7f9b901020d0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b80003e20 con 0x7f9b901020d0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b90100080 con 0x7f9b901020d0 2024-09-19T08:36:27.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80033050 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.195+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b901005c0 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.196+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9b8004a070 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.196+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b90107ca0 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.196+0000 7f9b8dffb640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9b7c0392a0 0x7f9b7c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.196+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9b8003e030 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.197+0000 7f9b8ffff640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9b7c0392a0 0x7f9b7c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.197+0000 7f9b8ffff640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9b7c0392a0 0x7f9b7c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b780098c0 tx=0x7f9b78006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.201+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b80001250 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.378+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f9b90190030 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.380+0000 7f9b8dffb640 1 -- 172.21.15.18:0/4052483229 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f9b800510c0 con 0x7f9b901020d0 2024-09-19T08:36:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9b7c0392a0 msgr2=0x7f9b7c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9b7c0392a0 0x7f9b7c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b780098c0 tx=0x7f9b78006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 msgr2=0x7f9b90101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b90101950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006010 tx=0x7f9b80030f50 comp rx=0 tx=0).stop 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 shutdown_connections 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9b7c0392a0 0x7f9b7c03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 --2- 172.21.15.18:0/4052483229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b901020d0 0x7f9b90101950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 >> 172.21.15.18:0/4052483229 conn(0x7f9b900fbcd0 msgr2=0x7f9b900fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 shutdown_connections 2024-09-19T08:36:27.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:27.383+0000 7f9b97104640 1 -- 172.21.15.18:0/4052483229 wait complete. 2024-09-19T08:36:28.475 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:36:28.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:36:28.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4052483229' entity='client.admin' 2024-09-19T08:36:28.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:28.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:28.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:28.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:28.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:28.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:28.941 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 -- 172.21.15.18:0/20722621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 msgr2=0x7fba301008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 --2- 172.21.15.18:0/20722621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba301008e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba20009880 tx=0x7fba2002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 -- 172.21.15.18:0/20722621 shutdown_connections 2024-09-19T08:36:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 --2- 172.21.15.18:0/20722621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba301008e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 -- 172.21.15.18:0/20722621 >> 172.21.15.18:0/20722621 conn(0x7fba300fbc90 msgr2=0x7fba300fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 -- 172.21.15.18:0/20722621 shutdown_connections 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.400+0000 7fba35a67640 1 -- 172.21.15.18:0/20722621 wait complete. 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.401+0000 7fba35a67640 1 Processor -- start 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.401+0000 7fba35a67640 1 -- start start 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.401+0000 7fba35a67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba3006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.401+0000 7fba35a67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fba301064a0 con 0x7fba301004e0 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba3006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba3006a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49658/0 (socket says 172.21.15.18:49658) 2024-09-19T08:36:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2f7fe640 1 -- 172.21.15.18:0/2494038848 learned_addr learned my addr 172.21.15.18:0/2494038848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2f7fe640 1 -- 172.21.15.18:0/2494038848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba30199a60 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2f7fe640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba3006a950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba20005ec0 tx=0x7fba200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2003f070 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba30199c30 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba20003aa0 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba20035030 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.402+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba30199fd0 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.403+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fba20042070 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.403+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba30106c20 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.404+0000 7fba2cff9640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fba180392a0 0x7fba1803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.404+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fba2006d180 con 0x7fba301004e0 2024-09-19T08:36:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.404+0000 7fba2effd640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fba180392a0 0x7fba1803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.404+0000 7fba2effd640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fba180392a0 0x7fba1803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fba240098c0 tx=0x7fba24006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.408+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba20003cc0 con 0x7fba301004e0 2024-09-19T08:36:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.590+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fba3002d9e0 con 0x7fba180392a0 2024-09-19T08:36:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.593+0000 7fba2cff9640 1 -- 172.21.15.18:0/2494038848 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fba3002d9e0 con 0x7fba180392a0 2024-09-19T08:36:29.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fba180392a0 msgr2=0x7fba1803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:29.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fba180392a0 0x7fba1803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fba240098c0 tx=0x7fba24006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 msgr2=0x7fba3006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:29.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba3006a950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba20005ec0 tx=0x7fba200048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 shutdown_connections 2024-09-19T08:36:29.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fba180392a0 0x7fba1803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 --2- 172.21.15.18:0/2494038848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba301004e0 0x7fba3006a950 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 >> 172.21.15.18:0/2494038848 conn(0x7fba300fbc90 msgr2=0x7fba300fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:29.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 shutdown_connections 2024-09-19T08:36:29.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:29.595+0000 7fba35a67640 1 -- 172.21.15.18:0/2494038848 wait complete. 2024-09-19T08:36:30.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:30.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:30.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:30.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:30.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:30.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T08:36:30.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:30.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:30.891 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:30.918 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi150 2024-09-19T08:36:30.918 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:36:30.918 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:30.937 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:36:30.938 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:30.996 INFO:tasks.cephadm:Adding host smithi150 to orchestrator... 2024-09-19T08:36:30.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch host add smithi150 2024-09-19T08:36:31.247 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:31.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:31 smithi018 ceph-mon[30956]: Updating smithi018:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:31.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:31 smithi018 ceph-mon[30956]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:31.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:31 smithi018 ceph-mon[30956]: Updating smithi018:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:31.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.710+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1735502331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 msgr2=0x7f4a9c102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:31.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.710+0000 7f4aa1a34640 1 --2- 172.21.15.18:0/1735502331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c102bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009c10 tx=0x7f4a8c02aa10 comp rx=0 tx=0).stop 2024-09-19T08:36:31.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1735502331 shutdown_connections 2024-09-19T08:36:31.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 --2- 172.21.15.18:0/1735502331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c102bb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1735502331 >> 172.21.15.18:0/1735502331 conn(0x7f4a9c077310 msgr2=0x7f4a9c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1735502331 shutdown_connections 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1735502331 wait complete. 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 Processor -- start 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.711+0000 7f4aa1a34640 1 -- start start 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa1a34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa1a34640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c10bb30 con 0x7f4a9c1027d0 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4a9affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4a9affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49676/0 (socket says 172.21.15.18:49676) 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4a9affd640 1 -- 172.21.15.18:0/1543332592 learned_addr learned my addr 172.21.15.18:0/1543332592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4a9affd640 1 -- 172.21.15.18:0/1543332592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c102320 con 0x7f4a9c1027d0 2024-09-19T08:36:31.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4a9affd640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c100430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c005dd0 tx=0x7f4a8c02f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8c034070 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a8c02feb0 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8c004360 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c100970 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.712+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c100dd0 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.713+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4a8c037020 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.713+0000 7f4aa0a32640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a880392a0 0x7f4a8803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.713+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c069ef0 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.714+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4a8c06d230 con 0x7f4a9c1027d0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.714+0000 7f4a9a7fc640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a880392a0 0x7f4a8803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.714+0000 7f4a9a7fc640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a880392a0 0x7f4a8803b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a840098c0 tx=0x7f4a84006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:31.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.718+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a8c03f070 con 0x7f4a9c1027d0 2024-09-19T08:36:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:31.897+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}) -- 0x7f4a9c101960 con 0x7f4a880392a0 2024-09-19T08:36:33.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:32 smithi018 ceph-mon[30956]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:34.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:33 smithi018 ceph-mon[30956]: Deploying cephadm binary to smithi150 2024-09-19T08:36:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.772+0000 7f4aa0a32640 1 -- 172.21.15.18:0/1543332592 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4a9c101960 con 0x7f4a880392a0 2024-09-19T08:36:35.773 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi150' with addr '172.21.15.150' 2024-09-19T08:36:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.775+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a880392a0 msgr2=0x7f4a8803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.775+0000 7f4aa1a34640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a880392a0 0x7f4a8803b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a840098c0 tx=0x7f4a84006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.775+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 msgr2=0x7f4a9c100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.775+0000 7f4aa1a34640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c100430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c005dd0 tx=0x7f4a8c02f980 comp rx=0 tx=0).stop 2024-09-19T08:36:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.776+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 shutdown_connections 2024-09-19T08:36:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.776+0000 7f4aa1a34640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a880392a0 0x7f4a8803b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.776+0000 7f4aa1a34640 1 --2- 172.21.15.18:0/1543332592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9c1027d0 0x7f4a9c100430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.776+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 >> 172.21.15.18:0/1543332592 conn(0x7f4a9c077310 msgr2=0x7f4a9c105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.776+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 shutdown_connections 2024-09-19T08:36:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:35.776+0000 7f4aa1a34640 1 -- 172.21.15.18:0/1543332592 wait complete. 2024-09-19T08:36:36.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:36:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:37.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:37.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:36 smithi018 ceph-mon[30956]: Added host smithi150 2024-09-19T08:36:37.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:37.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:37.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 -- 172.21.15.18:0/1849802658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 msgr2=0x7f1854106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 --2- 172.21.15.18:0/1849802658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f1854106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1844009880 tx=0x7f184402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 -- 172.21.15.18:0/1849802658 shutdown_connections 2024-09-19T08:36:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 --2- 172.21.15.18:0/1849802658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f1854106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 -- 172.21.15.18:0/1849802658 >> 172.21.15.18:0/1849802658 conn(0x7f18540fc1b0 msgr2=0x7f18540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 -- 172.21.15.18:0/1849802658 shutdown_connections 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.098+0000 7f185a932640 1 -- 172.21.15.18:0/1849802658 wait complete. 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f185a932640 1 Processor -- start 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f185a932640 1 -- start start 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f185a932640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f18540fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f185a932640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f185410aa40 con 0x7f1854106560 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f1853fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f18540fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f1853fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f18540fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49694/0 (socket says 172.21.15.18:49694) 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.099+0000 7f1853fff640 1 -- 172.21.15.18:0/2278993462 learned_addr learned my addr 172.21.15.18:0/2278993462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f1853fff640 1 -- 172.21.15.18:0/2278993462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18540fe550 con 0x7f1854106560 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f1853fff640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f18540fc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1844009230 tx=0x7f18440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f184403f070 con 0x7f1854106560 2024-09-19T08:36:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1844004d10 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18540fcba0 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1844035030 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.100+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18540fd060 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.101+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1844042070 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.101+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1854101bd0 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.101+0000 7f1851ffb640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f18400392a0 0x7f184003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.101+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f184406cfc0 con 0x7f1854106560 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.101+0000 7f184bfff640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f18400392a0 0x7f184003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.102+0000 7f184bfff640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f18400392a0 0x7f184003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f183c0098c0 tx=0x7f183c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.106+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1844042360 con 0x7f1854106560 2024-09-19T08:36:37.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.300+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18540fdc00 con 0x7f18400392a0 2024-09-19T08:36:37.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.301+0000 7f1851ffb640 1 -- 172.21.15.18:0/2278993462 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f18540fdc00 con 0x7f18400392a0 2024-09-19T08:36:37.302 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:37.302 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}] 2024-09-19T08:36:37.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f18400392a0 msgr2=0x7f184003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:37.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f18400392a0 0x7f184003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f183c0098c0 tx=0x7f183c006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 msgr2=0x7f18540fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:37.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f18540fc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1844009230 tx=0x7f18440048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 shutdown_connections 2024-09-19T08:36:37.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f18400392a0 0x7f184003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 --2- 172.21.15.18:0/2278993462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1854106560 0x7f18540fc660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 >> 172.21.15.18:0/2278993462 conn(0x7f18540fc1b0 msgr2=0x7f1854069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 shutdown_connections 2024-09-19T08:36:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:37.303+0000 7f185a932640 1 -- 172.21.15.18:0/2278993462 wait complete. 2024-09-19T08:36:37.909 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-19T08:36:37.910 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:36:37.910 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:37.930 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:36:37.930 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:37.988 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-19T08:36:37.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch host add smithi162 2024-09-19T08:36:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:38 smithi018 ceph-mon[30956]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:36:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.664+0000 7f6466d4c640 1 -- 172.21.15.18:0/4212096292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 msgr2=0x7f6460102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.664+0000 7f6466d4c640 1 --2- 172.21.15.18:0/4212096292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f6460102bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6450009880 tx=0x7f645002a670 comp rx=0 tx=0).stop 2024-09-19T08:36:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.664+0000 7f6466d4c640 1 -- 172.21.15.18:0/4212096292 shutdown_connections 2024-09-19T08:36:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.664+0000 7f6466d4c640 1 --2- 172.21.15.18:0/4212096292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f6460102bd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.664+0000 7f6466d4c640 1 -- 172.21.15.18:0/4212096292 >> 172.21.15.18:0/4212096292 conn(0x7f64600fc1b0 msgr2=0x7f64600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.664+0000 7f6466d4c640 1 -- 172.21.15.18:0/4212096292 shutdown_connections 2024-09-19T08:36:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.665+0000 7f6466d4c640 1 -- 172.21.15.18:0/4212096292 wait complete. 2024-09-19T08:36:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.665+0000 7f6466d4c640 1 Processor -- start 2024-09-19T08:36:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.665+0000 7f6466d4c640 1 -- start start 2024-09-19T08:36:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.665+0000 7f6466d4c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f64601970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.665+0000 7f6466d4c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f646010bb70 con 0x7f64601027f0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f6464ae8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f64601970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f6464ae8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f64601970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49718/0 (socket says 172.21.15.18:49718) 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f6464ae8640 1 -- 172.21.15.18:0/941127116 learned_addr learned my addr 172.21.15.18:0/941127116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f6464ae8640 1 -- 172.21.15.18:0/941127116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6460197630 con 0x7f64601027f0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f6464ae8640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f64601970f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6450009230 tx=0x7f64500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645003f070 con 0x7f64601027f0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64601978c0 con 0x7f64601027f0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6450003aa0 con 0x7f64601027f0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.666+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6450035030 con 0x7f64601027f0 2024-09-19T08:36:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.667+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6460197d20 con 0x7f64601027f0 2024-09-19T08:36:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.667+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6450042070 con 0x7f64601027f0 2024-09-19T08:36:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.668+0000 7f645dffb640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f64480392a0 0x7f644803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.668+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f645006e280 con 0x7f64601027f0 2024-09-19T08:36:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.668+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646006a710 con 0x7f64601027f0 2024-09-19T08:36:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.668+0000 7f645ffff640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f64480392a0 0x7f644803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.668+0000 7f645ffff640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f64480392a0 0x7f644803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f64540098c0 tx=0x7f6454006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:38.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.672+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6450036260 con 0x7f64601027f0 2024-09-19T08:36:38.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:38.852+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7f6460198480 con 0x7f64480392a0 2024-09-19T08:36:39.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:39 smithi018 ceph-mon[30956]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi150", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:40.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: Deploying cephadm binary to smithi162 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: Updating smithi150:/etc/ceph/ceph.conf 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: Updating smithi150:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:42.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:42 smithi018 ceph-mon[30956]: Updating smithi150:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:42.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.810+0000 7f645dffb640 1 -- 172.21.15.18:0/941127116 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6460198480 con 0x7f64480392a0 2024-09-19T08:36:42.811 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-19T08:36:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f64480392a0 msgr2=0x7f644803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f64480392a0 0x7f644803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f64540098c0 tx=0x7f6454006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 msgr2=0x7f64601970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f64601970f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6450009230 tx=0x7f64500048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 shutdown_connections 2024-09-19T08:36:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f64480392a0 0x7f644803b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 --2- 172.21.15.18:0/941127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64601027f0 0x7f64601970f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 >> 172.21.15.18:0/941127116 conn(0x7f64600fc1b0 msgr2=0x7f64601055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.812+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 shutdown_connections 2024-09-19T08:36:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:42.813+0000 7f6466d4c640 1 -- 172.21.15.18:0/941127116 wait complete. 2024-09-19T08:36:43.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:43 smithi018 ceph-mon[30956]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:43.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:43.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:43.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:43.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:36:43.669 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 -- 172.21.15.18:0/2232594541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 msgr2=0x7f4e0c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 --2- 172.21.15.18:0/2232594541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c106920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009810 tx=0x7f4dfc02a540 comp rx=0 tx=0).stop 2024-09-19T08:36:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 -- 172.21.15.18:0/2232594541 shutdown_connections 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 --2- 172.21.15.18:0/2232594541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c106920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 -- 172.21.15.18:0/2232594541 >> 172.21.15.18:0/2232594541 conn(0x7f4e0c077310 msgr2=0x7f4e0c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 -- 172.21.15.18:0/2232594541 shutdown_connections 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 -- 172.21.15.18:0/2232594541 wait complete. 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 Processor -- start 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.111+0000 7f4e12787640 1 -- start start 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e12787640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c0fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e12787640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c10aa20 con 0x7f4e0c106540 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c0fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c0fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58400/0 (socket says 172.21.15.18:58400) 2024-09-19T08:36:44.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e0bfff640 1 -- 172.21.15.18:0/4186616850 learned_addr learned my addr 172.21.15.18:0/4186616850 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e0bfff640 1 -- 172.21.15.18:0/4186616850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c0ff290 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.112+0000 7f4e0bfff640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c0fd3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc030b00 tx=0x7f4dfc030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.113+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dfc040070 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.113+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4dfc0318b0 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.113+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c0fd8e0 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.113+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dfc003de0 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.113+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c0fdda0 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.114+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4dfc039040 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.114+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c101bb0 con 0x7f4e0c106540 2024-09-19T08:36:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.114+0000 7f4e097fa640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4df4039300 0x7f4df403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.114+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4dfc06da10 con 0x7f4e0c106540 2024-09-19T08:36:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.114+0000 7f4e0b7fe640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4df4039300 0x7f4df403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.114+0000 7f4e0b7fe640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4df4039300 0x7f4df403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e000098c0 tx=0x7f4e00006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:44.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.119+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4dfc043bd0 con 0x7f4e0c106540 2024-09-19T08:36:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.303+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e0c0fe940 con 0x7f4df4039300 2024-09-19T08:36:44.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.304+0000 7f4e097fa640 1 -- 172.21.15.18:0/4186616850 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f4e0c0fe940 con 0x7f4df4039300 2024-09-19T08:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-19T08:36:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4df4039300 msgr2=0x7f4df403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4df4039300 0x7f4df403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e000098c0 tx=0x7f4e00006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 msgr2=0x7f4e0c0fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c0fd3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc030b00 tx=0x7f4dfc030b30 comp rx=0 tx=0).stop 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 shutdown_connections 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4df4039300 0x7f4df403b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 --2- 172.21.15.18:0/4186616850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c106540 0x7f4e0c0fd3a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 >> 172.21.15.18:0/4186616850 conn(0x7f4e0c077310 msgr2=0x7f4e0c0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 shutdown_connections 2024-09-19T08:36:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:44.306+0000 7f4e12787640 1 -- 172.21.15.18:0/4186616850 wait complete. 2024-09-19T08:36:44.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:44 smithi018 ceph-mon[30956]: Added host smithi162 2024-09-19T08:36:44.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:44.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:44.920 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:36:44.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:36:45.171 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:45 smithi018 ceph-mon[30956]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:45.560 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:45 smithi018 ceph-mon[30956]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:36:45.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 -- 172.21.15.18:0/214211041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 msgr2=0x7f7888106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:45.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 --2- 172.21.15.18:0/214211041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7878009880 tx=0x7f787802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 -- 172.21.15.18:0/214211041 shutdown_connections 2024-09-19T08:36:45.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 --2- 172.21.15.18:0/214211041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 -- 172.21.15.18:0/214211041 >> 172.21.15.18:0/214211041 conn(0x7f78880fc1b0 msgr2=0x7f78880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 -- 172.21.15.18:0/214211041 shutdown_connections 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.643+0000 7f788e9f6640 1 -- 172.21.15.18:0/214211041 wait complete. 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f788e9f6640 1 Processor -- start 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f788e9f6640 1 -- start start 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f788e9f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f788e9f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f788810aa40 con 0x7f7888106560 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f7887fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f7887fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58420/0 (socket says 172.21.15.18:58420) 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f7887fff640 1 -- 172.21.15.18:0/2504053416 learned_addr learned my addr 172.21.15.18:0/2504053416 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:36:45.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.644+0000 7f7887fff640 1 -- 172.21.15.18:0/2504053416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78881983d0 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.645+0000 7f7887fff640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888197e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7878009230 tx=0x7f78780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.645+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f787803f070 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.645+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7888198660 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.645+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7878004d10 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.645+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878035030 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.645+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7888198ac0 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.646+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7878042070 con 0x7f7888106560 2024-09-19T08:36:45.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.646+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7888101bd0 con 0x7f7888106560 2024-09-19T08:36:45.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.646+0000 7f78857fa640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78700392a0 0x7f787003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:45.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.646+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f787806d100 con 0x7f7888106560 2024-09-19T08:36:45.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.646+0000 7f78877fe640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78700392a0 0x7f787003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.647+0000 7f78877fe640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78700392a0 0x7f787003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f787c0098c0 tx=0x7f787c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:45.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.651+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78780035f0 con 0x7f7888106560 2024-09-19T08:36:45.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:45.832+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f78881069c0 con 0x7f7888106560 2024-09-19T08:36:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.389+0000 7f78857fa640 1 -- 172.21.15.18:0/2504053416 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f7878003810 con 0x7f7888106560 2024-09-19T08:36:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-19T08:36:46.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78700392a0 msgr2=0x7f787003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:46.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78700392a0 0x7f787003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f787c0098c0 tx=0x7f787c006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 msgr2=0x7f7888197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:46.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888197e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7878009230 tx=0x7f78780048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 shutdown_connections 2024-09-19T08:36:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78700392a0 0x7f787003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 --2- 172.21.15.18:0/2504053416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7888106560 0x7f7888197e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.393+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 >> 172.21.15.18:0/2504053416 conn(0x7f78880fc1b0 msgr2=0x7f78880fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.394+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 shutdown_connections 2024-09-19T08:36:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:36:46.394+0000 7f788e9f6640 1 -- 172.21.15.18:0/2504053416 wait complete. 2024-09-19T08:36:46.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:46 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2504053416' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:36:46.941 INFO:tasks.cephadm:Adding mon.a on smithi018 2024-09-19T08:36:46.941 INFO:tasks.cephadm:Adding mon.b on smithi150 2024-09-19T08:36:46.941 INFO:tasks.cephadm:Adding mon.c on smithi162 2024-09-19T08:36:46.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c' 2024-09-19T08:36:47.201 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:36:47.246 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:36:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2504053416' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:36:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 -- 172.21.15.162:0/1531947280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 msgr2=0x7f03a01044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 --2- 172.21.15.162:0/1531947280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a01044f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0390009880 tx=0x7f039002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 -- 172.21.15.162:0/1531947280 shutdown_connections 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 --2- 172.21.15.162:0/1531947280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a01044f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 -- 172.21.15.162:0/1531947280 >> 172.21.15.162:0/1531947280 conn(0x7f03a00fbc80 msgr2=0x7f03a00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 -- 172.21.15.162:0/1531947280 shutdown_connections 2024-09-19T08:36:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.723+0000 7f03a6373640 1 -- 172.21.15.162:0/1531947280 wait complete. 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f03a6373640 1 Processor -- start 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f03a6373640 1 -- start start 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f03a6373640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f03a6373640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01075c0 con 0x7f03a0102100 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f039ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f039ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a0196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:56488/0 (socket says 172.21.15.162:56488) 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.724+0000 7f039ffff640 1 -- 172.21.15.162:0/3246416043 learned_addr learned my addr 172.21.15.162:0/3246416043 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f039ffff640 1 -- 172.21.15.162:0/3246416043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a01971d0 con 0x7f03a0102100 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f039ffff640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a0196c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0390009230 tx=0x7f03900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f039003f070 con 0x7f03a0102100 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a0197460 con 0x7f03a0102100 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0390003aa0 con 0x7f03a0102100 2024-09-19T08:36:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0390035030 con 0x7f03a0102100 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.725+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a019a150 con 0x7f03a0102100 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.726+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0390042070 con 0x7f03a0102100 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.726+0000 7f039d7fa640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03880392a0 0x7f038803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.726+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a0107d40 con 0x7f03a0102100 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.726+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f039006d2a0 con 0x7f03a0102100 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.726+0000 7f039f7fe640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03880392a0 0x7f038803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.727+0000 7f039f7fe640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03880392a0 0x7f038803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f03940098c0 tx=0x7f0394006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:47.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.731+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f039002f300 con 0x7f03a0102100 2024-09-19T08:36:47.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.919+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}) -- 0x7f03a002d8f0 con 0x7f03880392a0 2024-09-19T08:36:47.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.924+0000 7f039d7fa640 1 -- 172.21.15.162:0/3246416043 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f03a002d8f0 con 0x7f03880392a0 2024-09-19T08:36:47.925 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-09-19T08:36:47.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03880392a0 msgr2=0x7f038803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:47.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03880392a0 0x7f038803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f03940098c0 tx=0x7f0394006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 msgr2=0x7f03a0196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:47.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a0196c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0390009230 tx=0x7f03900048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 shutdown_connections 2024-09-19T08:36:47.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03880392a0 0x7f038803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 --2- 172.21.15.162:0/3246416043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03a0102100 0x7f03a0196c90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 >> 172.21.15.162:0/3246416043 conn(0x7f03a00fbc80 msgr2=0x7f03a00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:47.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 shutdown_connections 2024-09-19T08:36:47.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:47.926+0000 7f03a6373640 1 -- 172.21.15.162:0/3246416043 wait complete. 2024-09-19T08:36:48.469 DEBUG:teuthology.orchestra.run.smithi150:mon.b> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:36:48.472 DEBUG:teuthology.orchestra.run.smithi162:mon.c> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:36:48.475 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:48.475 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:48.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:48.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:48.617 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.745 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:49.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 -- 172.21.15.162:0/3505388630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 msgr2=0x7f55bc102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 --2- 172.21.15.162:0/3505388630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc102bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009810 tx=0x7f55b802a540 comp rx=0 tx=0).stop 2024-09-19T08:36:49.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 -- 172.21.15.162:0/3505388630 shutdown_connections 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 --2- 172.21.15.162:0/3505388630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc102bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 -- 172.21.15.162:0/3505388630 >> 172.21.15.162:0/3505388630 conn(0x7f55bc077310 msgr2=0x7f55bc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 -- 172.21.15.162:0/3505388630 shutdown_connections 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.164+0000 7f55c3c30640 1 -- 172.21.15.162:0/3505388630 wait complete. 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.165+0000 7f55c3c30640 1 Processor -- start 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.165+0000 7f55c3c30640 1 -- start start 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.165+0000 7f55c3c30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.165+0000 7f55c3c30640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10bb30 con 0x7f55bc1027d0 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.165+0000 7f55c19cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55c19cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:56506/0 (socket says 172.21.15.162:56506) 2024-09-19T08:36:49.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55c19cc640 1 -- 172.21.15.162:0/1982428380 learned_addr learned my addr 172.21.15.162:0/1982428380 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55c19cc640 1 -- 172.21.15.162:0/1982428380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc197580 con 0x7f55bc1027d0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55c19cc640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc197040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55b8030b00 tx=0x7f55b8030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b8040070 con 0x7f55bc1027d0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc197810 con 0x7f55bc1027d0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55b80318b0 con 0x7f55bc1027d0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b8003de0 con 0x7f55bc1027d0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.166+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc197c70 con 0x7f55bc1027d0 2024-09-19T08:36:49.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.167+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f55b8039040 con 0x7f55bc1027d0 2024-09-19T08:36:49.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.167+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc069ef0 con 0x7f55bc1027d0 2024-09-19T08:36:49.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.167+0000 7f55b2ffd640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55a80392a0 0x7f55a803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.168+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55b806d8d0 con 0x7f55bc1027d0 2024-09-19T08:36:49.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.168+0000 7f55c11cb640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55a80392a0 0x7f55a803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.168+0000 7f55c11cb640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55a80392a0 0x7f55a803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0098c0 tx=0x7f55ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:49.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.174+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55b8003730 con 0x7f55bc1027d0 2024-09-19T08:36:49.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.407+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f55bc198400 con 0x7f55bc1027d0 2024-09-19T08:36:49.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.408+0000 7f55b2ffd640 1 -- 172.21.15.162:0/1982428380 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f55b8043c60 con 0x7f55bc1027d0 2024-09-19T08:36:49.409 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:36:49.409 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:35:25.490759Z","created":"2024-09-19T08:35:25.490759Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:36:49.409 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.411+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55a80392a0 msgr2=0x7f55a803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.411+0000 7f55c3c30640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55a80392a0 0x7f55a803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0098c0 tx=0x7f55ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 msgr2=0x7f55bc197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc197040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55b8030b00 tx=0x7f55b8030b30 comp rx=0 tx=0).stop 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 shutdown_connections 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55a80392a0 0x7f55a803b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 --2- 172.21.15.162:0/1982428380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55bc1027d0 0x7f55bc197040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 >> 172.21.15.162:0/1982428380 conn(0x7f55bc077310 msgr2=0x7f55bc105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 shutdown_connections 2024-09-19T08:36:49.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:49.412+0000 7f55c3c30640 1 -- 172.21.15.162:0/1982428380 wait complete. 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c;count:3 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.a on smithi018 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:49.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:49.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:49.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:49.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:49.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:49.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:50.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:50 smithi018 ceph-mon[30956]: Deploying daemon mon.c on smithi162 2024-09-19T08:36:50.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1982428380' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:50.970 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:50.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:51.602 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:51.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:51 smithi018 ceph-mon[30956]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:52.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.523+0000 7f98c0910640 1 -- 172.21.15.162:0/3979152965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 msgr2=0x7f98bc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.523+0000 7f98c0910640 1 --2- 172.21.15.162:0/3979152965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc107a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009880 tx=0x7f98b002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 -- 172.21.15.162:0/3979152965 shutdown_connections 2024-09-19T08:36:52.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 --2- 172.21.15.162:0/3979152965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc107a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 -- 172.21.15.162:0/3979152965 >> 172.21.15.162:0/3979152965 conn(0x7f98bc0fd270 msgr2=0x7f98bc0ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:52.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 -- 172.21.15.162:0/3979152965 shutdown_connections 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 -- 172.21.15.162:0/3979152965 wait complete. 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 Processor -- start 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.524+0000 7f98c0910640 1 -- start start 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98c0910640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98c0910640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc10bb40 con 0x7f98bc107660 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98ba59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98ba59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:56530/0 (socket says 172.21.15.162:56530) 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98ba59c640 1 -- 172.21.15.162:0/1447664738 learned_addr learned my addr 172.21.15.162:0/1447664738 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98ba59c640 1 -- 172.21.15.162:0/1447664738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc0763e0 con 0x7f98bc107660 2024-09-19T08:36:52.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.525+0000 7f98ba59c640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc0744f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009230 tx=0x7f98b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:52.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.526+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b003f070 con 0x7f98bc107660 2024-09-19T08:36:52.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.526+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98bc074a30 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.526+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98b0004d10 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.526+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b0035030 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.526+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98bc074ef0 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.527+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f98b0042070 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.527+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98bc102cd0 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.527+0000 7f98ab7fe640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f98a40392a0 0x7f98a403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.527+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f98b006d0a0 con 0x7f98bc107660 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.527+0000 7f98b9d9b640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f98a40392a0 0x7f98a403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:52.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.528+0000 7f98b9d9b640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f98a40392a0 0x7f98a403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0098c0 tx=0x7f98ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:52.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.532+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98b002f300 con 0x7f98bc107660 2024-09-19T08:36:52.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.792+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f98bc075a20 con 0x7f98bc107660 2024-09-19T08:36:52.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.793+0000 7f98ab7fe640 1 -- 172.21.15.162:0/1447664738 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f98b0031400 con 0x7f98bc107660 2024-09-19T08:36:52.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:36:52.793 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:35:25.490759Z","created":"2024-09-19T08:35:25.490759Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:36:52.794 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f98a40392a0 msgr2=0x7f98a403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f98a40392a0 0x7f98a403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0098c0 tx=0x7f98ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 msgr2=0x7f98bc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc0744f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009230 tx=0x7f98b00048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 shutdown_connections 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f98a40392a0 0x7f98a403b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 --2- 172.21.15.162:0/1447664738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98bc107660 0x7f98bc0744f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 >> 172.21.15.162:0/1447664738 conn(0x7f98bc0fd270 msgr2=0x7f98bc0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:52.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 shutdown_connections 2024-09-19T08:36:52.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:52.796+0000 7f98c0910640 1 -- 172.21.15.162:0/1447664738 wait complete. 2024-09-19T08:36:53.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:53 smithi018 ceph-mon[30956]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:53.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:53 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1447664738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:53.849 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T08:36:53.849 INFO:journalctl@ceph.mon.c.smithi162.stdout: e1 2024-09-19T08:36:53.849 INFO:journalctl@ceph.mon.c.smithi162.stdout: btime 2024-09-19T08:35:30:772232+0000 2024-09-19T08:36:53.849 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:36:53.849 INFO:journalctl@ceph.mon.c.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout: legacy client fscid: -1 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout: No filesystems configured 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:36:53.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:36:53.851 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Added host smithi162 2024-09-19T08:36:54.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2504053416' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2504053416' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c;count:3 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Reconfiguring daemon mon.a on smithi018 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: Deploying daemon mon.c on smithi162 2024-09-19T08:36:54.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/1982428380' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:54.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/1447664738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:54.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 ceph-mon[34870]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:36:54.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 bash[34851]: 45df618ba8fcd21af27160ead3598cdabfe1c84a4119033fa1aa500201f8b6cc 2024-09-19T08:36:54.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:53 smithi162 systemd[1]: Started Ceph mon.c for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:36:54.366 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:54.366 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:54.617 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:36:59.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:59.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:59.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: monmap epoch 2 2024-09-19T08:36:59.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: last_changed 2024-09-19T08:36:53.855061+0000 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: created 2024-09-19T08:35:25.490759+0000 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: fsmap 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 41s) 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:59.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:59.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:59.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:59.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: mon.a calling monitor election 2024-09-19T08:36:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: mon.c calling monitor election 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: monmap epoch 2 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: last_changed 2024-09-19T08:36:53.855061+0000 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: created 2024-09-19T08:35:25.490759+0000 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: min_mon_release 19 (squid) 2024-09-19T08:36:59.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: election_strategy: 1 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: fsmap 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: mgrmap e13: x(active, since 41s) 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: overall HEALTH_OK 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:59.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:59.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 -- 172.21.15.162:0/750726637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 msgr2=0x7fad900059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 --2- 172.21.15.162:0/750726637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fad900059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fada4102b40 tx=0x7fad9402c490 comp rx=0 tx=0).stop 2024-09-19T08:36:59.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 -- 172.21.15.162:0/750726637 shutdown_connections 2024-09-19T08:36:59.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 --2- 172.21.15.162:0/750726637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fad900059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 -- 172.21.15.162:0/750726637 >> 172.21.15.162:0/750726637 conn(0x7fada40fd390 msgr2=0x7fada40ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:59.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 -- 172.21.15.162:0/750726637 shutdown_connections 2024-09-19T08:36:59.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.438+0000 7fadabe5e640 1 -- 172.21.15.162:0/750726637 wait complete. 2024-09-19T08:36:59.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fadabe5e640 1 Processor -- start 2024-09-19T08:36:59.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fadabe5e640 1 -- start start 2024-09-19T08:36:59.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fadabe5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fada40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fadabe5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fadabe5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fada4109680 con 0x7fad90003530 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fadabe5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fada4109500 con 0x7fada4074a30 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:38474/0 (socket says 172.21.15.162:38474) 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 -- 172.21.15.162:0/2120590848 learned_addr learned my addr 172.21.15.162:0/2120590848 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:36:59.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada9bfa640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fada40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 -- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 msgr2=0x7fada4074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 -- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 msgr2=0x7fada4074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.439+0000 7fada93f9640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fada9bfa640 1 -- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 msgr2=0x7fada4074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fada9bfa640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fada9bfa640 1 -- 172.21.15.162:0/2120590848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada40763e0 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fada9bfa640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fada40744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad94036040 tx=0x7fad940339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fad94005110 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad94041070 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada41a3490 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fad940048f0 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.440+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada41a3a20 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.441+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fad94004b20 con 0x7fad90003530 2024-09-19T08:36:59.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.442+0000 7fad9affd640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad88039090 0x7fad8803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.442+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad9406e630 con 0x7fad90003530 2024-09-19T08:36:59.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.442+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada4102df0 con 0x7fad90003530 2024-09-19T08:36:59.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.442+0000 7fada93f9640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad88039090 0x7fad8803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.442+0000 7fada93f9640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad88039090 0x7fad8803b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fada0009100 tx=0x7fada0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:59.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.447+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad94043d70 con 0x7fad90003530 2024-09-19T08:36:59.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.679+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fada4075ac0 con 0x7fad90003530 2024-09-19T08:36:59.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.680+0000 7fad9affd640 1 -- 172.21.15.162:0/2120590848 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fad940052b0 con 0x7fad90003530 2024-09-19T08:36:59.680 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:36:59.681 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:36:53.855061Z","created":"2024-09-19T08:35:25.490759Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad88039090 msgr2=0x7fad8803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad88039090 0x7fad8803b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fada0009100 tx=0x7fada0008040 comp rx=0 tx=0).stop 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 msgr2=0x7fada40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fada40744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad94036040 tx=0x7fad940339a0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 shutdown_connections 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad88039090 0x7fad8803b550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada4074a30 0x7fada4074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 --2- 172.21.15.162:0/2120590848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad90003530 0x7fada40744f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 >> 172.21.15.162:0/2120590848 conn(0x7fada40fd390 msgr2=0x7fada418fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:59.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 shutdown_connections 2024-09-19T08:36:59.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:36:59.682+0000 7fadabe5e640 1 -- 172.21.15.162:0/2120590848 wait complete. 2024-09-19T08:37:00.021 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:59 smithi162 ceph-mon[34870]: Deploying daemon mon.b on smithi150 2024-09-19T08:37:00.021 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:59 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/2120590848' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:37:00.021 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:36:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:37:00.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:59 smithi018 ceph-mon[30956]: Deploying daemon mon.b on smithi150 2024-09-19T08:37:00.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:59 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/2120590848' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:37:00.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:36:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:37:01.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:00 smithi018 ceph-mon[30956]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:01.275 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:37:01.276 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:37:01.305 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:00 smithi162 ceph-mon[34870]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:01.532 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:37:01.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/2806858488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68106630 msgr2=0x7f3d68106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/2806858488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68106630 0x7f3d68106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009880 tx=0x7f3d5802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/2806858488 shutdown_connections 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/2806858488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68106630 0x7f3d68106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/2806858488 >> 172.21.15.162:0/2806858488 conn(0x7f3d680fc220 msgr2=0x7f3d680fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/2806858488 shutdown_connections 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.937+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/2806858488 wait complete. 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.938+0000 7f3d6e0e8640 1 Processor -- start 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.938+0000 7f3d6e0e8640 1 -- start start 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.938+0000 7f3d6e0e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d6e0e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68197730 0x7f3d6819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d6e0e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6810ab10 con 0x7f3d68197730 2024-09-19T08:37:01.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d6e0e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6810a990 con 0x7f3d68106630 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:38488/0 (socket says 172.21.15.162:38488) 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 -- 172.21.15.162:0/1915268841 learned_addr learned my addr 172.21.15.162:0/1915268841 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 -- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 msgr2=0x7f3d681971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 -- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 msgr2=0x7f3d681971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d677fe640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d66ffd640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68197730 0x7f3d6819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d66ffd640 1 -- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 msgr2=0x7f3d681971f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d66ffd640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d66ffd640 1 -- 172.21.15.162:0/1915268841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d68197d50 con 0x7f3d68197730 2024-09-19T08:37:01.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.939+0000 7f3d66ffd640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68197730 0x7f3d6819bac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00b3d0 tx=0x7f3d5c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.940+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3d5c011630 con 0x7f3d68197730 2024-09-19T08:37:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.940+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6819c000 con 0x7f3d68197730 2024-09-19T08:37:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.940+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d5c011c80 con 0x7f3d68197730 2024-09-19T08:37:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.940+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3d5c010d80 con 0x7f3d68197730 2024-09-19T08:37:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.940+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6819c5c0 con 0x7f3d68197730 2024-09-19T08:37:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.941+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3d5c018020 con 0x7f3d68197730 2024-09-19T08:37:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.941+0000 7f3d64ff9640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3d50039030 0x7f3d5003b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.941+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6819c8d0 con 0x7f3d68197730 2024-09-19T08:37:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.941+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3d5c04bff0 con 0x7f3d68197730 2024-09-19T08:37:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.941+0000 7f3d677fe640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3d50039030 0x7f3d5003b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.942+0000 7f3d677fe640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3d50039030 0x7f3d5003b4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802abc0 tx=0x7f3d5802aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:01.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:01.946+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d5c01f020 con 0x7f3d68197730 2024-09-19T08:37:02.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.176+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3d68198550 con 0x7f3d68197730 2024-09-19T08:37:02.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.177+0000 7f3d64ff9640 1 -- 172.21.15.162:0/1915268841 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3d5c018310 con 0x7f3d68197730 2024-09-19T08:37:02.177 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:37:02.177 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:36:53.855061Z","created":"2024-09-19T08:35:25.490759Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:37:02.178 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-19T08:37:02.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3d50039030 msgr2=0x7f3d5003b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:02.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3d50039030 0x7f3d5003b4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802abc0 tx=0x7f3d5802aad0 comp rx=0 tx=0).stop 2024-09-19T08:37:02.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68197730 msgr2=0x7f3d6819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:02.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68197730 0x7f3d6819bac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00b3d0 tx=0x7f3d5c00b890 comp rx=0 tx=0).stop 2024-09-19T08:37:02.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 shutdown_connections 2024-09-19T08:37:02.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3d50039030 0x7f3d5003b4f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:02.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d68197730 0x7f3d6819bac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:02.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 --2- 172.21.15.162:0/1915268841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68106630 0x7f3d681971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:02.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 >> 172.21.15.162:0/1915268841 conn(0x7f3d680fc220 msgr2=0x7f3d68104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:02.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 shutdown_connections 2024-09-19T08:37:02.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:02.179+0000 7f3d6e0e8640 1 -- 172.21.15.162:0/1915268841 wait complete. 2024-09-19T08:37:02.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:02 smithi150 systemd[1]: Started Ceph mon.b for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:37:03.740 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:37:03.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:37:03.991 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.644+0000 7efd1b279640 1 -- 172.21.15.162:0/3936036645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd00003530 msgr2=0x7efd000059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.644+0000 7efd1b279640 1 --2- 172.21.15.162:0/3936036645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd00003530 0x7efd000059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd1406a9e0 tx=0x7efd1002c150 comp rx=0 tx=0).stop 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.644+0000 7efd1b279640 1 -- 172.21.15.162:0/3936036645 shutdown_connections 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.644+0000 7efd1b279640 1 --2- 172.21.15.162:0/3936036645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd00003530 0x7efd000059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.644+0000 7efd1b279640 1 -- 172.21.15.162:0/3936036645 >> 172.21.15.162:0/3936036645 conn(0x7efd140fc220 msgr2=0x7efd140fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.645+0000 7efd1b279640 1 -- 172.21.15.162:0/3936036645 shutdown_connections 2024-09-19T08:37:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.645+0000 7efd1b279640 1 -- 172.21.15.162:0/3936036645 wait complete. 2024-09-19T08:37:07.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.645+0000 7efd1b279640 1 Processor -- start 2024-09-19T08:37:07.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.645+0000 7efd1b279640 1 -- start start 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd1b279640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 0x7efd14199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd1b279640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 0x7efd1419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd1b279640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 0x7efd1419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd1b279640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd1410b820 con 0x7efd1419e330 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd1b279640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efd1410b6a0 con 0x7efd00003530 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd1b279640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd1410b9a0 con 0x7efd14199a60 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 0x7efd1419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 0x7efd1419e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:46008/0 (socket says 172.21.15.162:46008) 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 -- 172.21.15.162:0/4257607070 learned_addr learned my addr 172.21.15.162:0/4257607070 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd18814640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 0x7efd1419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19015640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 0x7efd14199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd18814640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 msgr2=0x7efd1419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd18814640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 msgr2=0x7efd1419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd18814640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 0x7efd1419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd18814640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 0x7efd1419ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19015640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 msgr2=0x7efd14199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19015640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 msgr2=0x7efd14199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19015640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 0x7efd14199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 msgr2=0x7efd1419ddf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 0x7efd1419ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19015640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 0x7efd14199520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:37:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 msgr2=0x7efd14199520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 0x7efd14199520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.646+0000 7efd19816640 1 -- 172.21.15.162:0/4257607070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd141a60a0 con 0x7efd1419e330 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.647+0000 7efd19816640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 0x7efd1419e7e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00ba50 tx=0x7efd0c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.647+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c019070 con 0x7efd1419e330 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.647+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd0c00cbe0 con 0x7efd1419e330 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.647+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd141a62d0 con 0x7efd1419e330 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.647+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0075d0 con 0x7efd1419e330 2024-09-19T08:37:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.647+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd141a67e0 con 0x7efd1419e330 2024-09-19T08:37:07.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.648+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7efd0c01c070 con 0x7efd1419e330 2024-09-19T08:37:07.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.648+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1410c8d0 con 0x7efd1419e330 2024-09-19T08:37:07.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.648+0000 7efd0a7fc640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7efcf8039730 0x7efcf803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.649+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efd0c04be60 con 0x7efd1419e330 2024-09-19T08:37:07.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.649+0000 7efd19015640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7efcf8039730 0x7efcf803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.649+0000 7efd19015640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7efcf8039730 0x7efcf803bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd10005dc0 tx=0x7efd10005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.654+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd0c012500 con 0x7efd1419e330 2024-09-19T08:37:07.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.901+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efd14192970 con 0x7efd1419e330 2024-09-19T08:37:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.902+0000 7efd0a7fc640 1 -- 172.21.15.162:0/4257607070 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7efd0c00e090 con 0x7efd1419e330 2024-09-19T08:37:07.902 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:37:07.902 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:37:02.532826Z","created":"2024-09-19T08:35:25.490759Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-19T08:37:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: mon.a calling monitor election 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: mon.c calling monitor election 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: mon.b calling monitor election 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: monmap epoch 3 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: last_changed 2024-09-19T08:37:02.532826+0000 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: created 2024-09-19T08:35:25.490759+0000 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: min_mon_release 19 (squid) 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: election_strategy: 1 2024-09-19T08:37:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: 2: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: fsmap 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: mgrmap e13: x(active, since 49s) 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: overall HEALTH_OK 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.904+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7efcf8039730 msgr2=0x7efcf803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.904+0000 7efd1b279640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7efcf8039730 0x7efcf803bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd10005dc0 tx=0x7efd10005d10 comp rx=0 tx=0).stop 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.904+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 msgr2=0x7efd1419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.904+0000 7efd1b279640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 0x7efd1419e7e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00ba50 tx=0x7efd0c00bf10 comp rx=0 tx=0).stop 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 shutdown_connections 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7efcf8039730 0x7efcf803bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd1419e330 0x7efd1419e7e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd14199a60 0x7efd1419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 --2- 172.21.15.162:0/4257607070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd00003530 0x7efd14199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 >> 172.21.15.162:0/4257607070 conn(0x7efd140fc220 msgr2=0x7efd140fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:07.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 shutdown_connections 2024-09-19T08:37:07.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:07.905+0000 7efd1b279640 1 -- 172.21.15.162:0/4257607070 wait complete. 2024-09-19T08:37:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:37:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: mon.b calling monitor election 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: monmap epoch 3 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: last_changed 2024-09-19T08:37:02.532826+0000 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: created 2024-09-19T08:35:25.490759+0000 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: 2: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: fsmap 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 49s) 2024-09-19T08:37:07.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T08:37:07.947 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.947 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.947 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:07.947 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:37:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: mon.a calling monitor election 2024-09-19T08:37:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: mon.c calling monitor election 2024-09-19T08:37:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:37:08.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:08.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: mon.b calling monitor election 2024-09-19T08:37:08.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: monmap epoch 3 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:37:08.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: last_changed 2024-09-19T08:37:02.532826+0000 2024-09-19T08:37:08.069 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: created 2024-09-19T08:35:25.490759+0000 2024-09-19T08:37:08.069 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: min_mon_release 19 (squid) 2024-09-19T08:37:08.069 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: election_strategy: 1 2024-09-19T08:37:08.069 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T08:37:08.069 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T08:37:08.069 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: 2: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-19T08:37:08.070 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: fsmap 2024-09-19T08:37:08.070 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:37:08.070 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: mgrmap e13: x(active, since 49s) 2024-09-19T08:37:08.070 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: overall HEALTH_OK 2024-09-19T08:37:08.070 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.071 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.071 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.071 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.461 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:37:08.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:37:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:37:08.785 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:08.785 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.786 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:08 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/4257607070' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:37:08.786 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:08.839 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:08.839 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:08.839 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:08 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/4257607070' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:37:08.839 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:08 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/4257607070' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:37:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 -- 172.21.15.18:0/1173396841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114106650 msgr2=0x7f9114106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 --2- 172.21.15.18:0/1173396841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114106650 0x7f9114106a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9104009880 tx=0x7f910402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 -- 172.21.15.18:0/1173396841 shutdown_connections 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 --2- 172.21.15.18:0/1173396841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114106650 0x7f9114106a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 -- 172.21.15.18:0/1173396841 >> 172.21.15.18:0/1173396841 conn(0x7f91140fc280 msgr2=0x7f91140fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 -- 172.21.15.18:0/1173396841 shutdown_connections 2024-09-19T08:37:09.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 -- 172.21.15.18:0/1173396841 wait complete. 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 Processor -- start 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.174+0000 7f9119a91640 1 -- start start 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9119a91640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9114106650 0x7f9114197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9119a91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 0x7f911419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9119a91640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f911419c220 0x7f911419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9119a91640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f911410aae0 con 0x7f9114197950 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9119a91640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f911410a960 con 0x7f9114106650 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9119a91640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f911410ac60 con 0x7f911419c220 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 0x7f911419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 0x7f911419bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46544/0 (socket says 172.21.15.18:46544) 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 -- 172.21.15.18:0/1181944844 learned_addr learned my addr 172.21.15.18:0/1181944844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f91137fe640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9114106650 0x7f9114197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9113fff640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f911419c220 0x7f911419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 -- 172.21.15.18:0/1181944844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f911419c220 msgr2=0x7f911419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f911419c220 0x7f911419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 -- 172.21.15.18:0/1181944844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9114106650 msgr2=0x7f9114197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9114106650 0x7f9114197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 -- 172.21.15.18:0/1181944844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91141a3f90 con 0x7f9114197950 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f91137fe640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9114106650 0x7f9114197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f9113fff640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f911419c220 0x7f911419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.175+0000 7f910affd640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 0x7f911419bce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00b520 tx=0x7f90fc00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.176+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc004230 con 0x7f9114197950 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.176+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90fc0043d0 con 0x7f9114197950 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.176+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91141a41c0 con 0x7f9114197950 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.176+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc003cf0 con 0x7f9114197950 2024-09-19T08:37:09.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.176+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91141a46d0 con 0x7f9114197950 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.176+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f90fc00e070 con 0x7f9114197950 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.177+0000 7f91117fa640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9100039730 0x7f910003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.177+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f90fc04bd90 con 0x7f9114197950 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.177+0000 7f91137fe640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9100039730 0x7f910003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.177+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9114106ab0 con 0x7f9114197950 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.177+0000 7f91137fe640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9100039730 0x7f910003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9104006010 tx=0x7f9104005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.182+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f90fc014020 con 0x7f9114197950 2024-09-19T08:37:09.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.361+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f91141a4960 con 0x7f9114197950 2024-09-19T08:37:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.362+0000 7f91117fa640 1 -- 172.21.15.18:0/1181944844 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f90fc014200 con 0x7f9114197950 2024-09-19T08:37:09.362 INFO:teuthology.orchestra.run.smithi018.stdout:# minimal ceph.conf for ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:37:09.362 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-19T08:37:09.362 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:37:09.362 INFO:teuthology.orchestra.run.smithi018.stdout: mon_host = [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9100039730 msgr2=0x7f910003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9100039730 0x7f910003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9104006010 tx=0x7f9104005a20 comp rx=0 tx=0).stop 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 msgr2=0x7f911419bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 0x7f911419bce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00b520 tx=0x7f90fc00b9e0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 shutdown_connections 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9100039730 0x7f910003bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f911419c220 0x7f911419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9114197950 0x7f911419bce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 --2- 172.21.15.18:0/1181944844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9114106650 0x7f9114197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 >> 172.21.15.18:0/1181944844 conn(0x7f91140fc280 msgr2=0x7f9114069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 shutdown_connections 2024-09-19T08:37:09.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:09.364+0000 7f9119a91640 1 -- 172.21.15.18:0/1181944844 wait complete. 2024-09-19T08:37:09.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:09 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1181944844' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:09 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1181944844' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:10.046 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:37:10.046 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:37:10.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:09 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1181944844' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:10.075 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:37:10.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:37:10.141 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:37:10.141 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:37:10.169 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:37:10.169 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:37:10.235 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:37:10.235 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:37:10.262 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:37:10.263 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:37:10.328 INFO:tasks.cephadm:Adding mgr.x on smithi018 2024-09-19T08:37:10.328 INFO:tasks.cephadm:Adding mgr.y on smithi150 2024-09-19T08:37:10.329 INFO:tasks.cephadm:Adding mgr.z on smithi162 2024-09-19T08:37:10.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi018=x;smithi150=y;smithi162=z' 2024-09-19T08:37:10.603 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: Updating smithi150:/etc/ceph/ceph.conf 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: Updating smithi150:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: Updating smithi018:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:10.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:10.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: Updating smithi150:/etc/ceph/ceph.conf 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: Updating smithi150:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: Updating smithi018:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.864 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:10.865 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 -- 172.21.15.162:0/593024512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 msgr2=0x7f0b2c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 --2- 172.21.15.162:0/593024512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c1009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009880 tx=0x7f0b1c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 -- 172.21.15.162:0/593024512 shutdown_connections 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 --2- 172.21.15.162:0/593024512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c1009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 -- 172.21.15.162:0/593024512 >> 172.21.15.162:0/593024512 conn(0x7f0b2c0fbda0 msgr2=0x7f0b2c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 -- 172.21.15.162:0/593024512 shutdown_connections 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.021+0000 7f0b31b80640 1 -- 172.21.15.162:0/593024512 wait complete. 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 Processor -- start 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 -- start start 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b2c197490 0x7f0b2c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b2c197910 0x7f0b2c19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c106590 con 0x7f0b2c1005f0 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c106410 con 0x7f0b2c197910 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b31b80640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c106710 con 0x7f0b2c197490 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:46020/0 (socket says 172.21.15.162:46020) 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2b7fe640 1 -- 172.21.15.162:0/1511199334 learned_addr learned my addr 172.21.15.162:0/1511199334 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2affd640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b2c197490 0x7f0b2c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2bfff640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b2c197910 0x7f0b2c19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2b7fe640 1 -- 172.21.15.162:0/1511199334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b2c197490 msgr2=0x7f0b2c19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2b7fe640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b2c197490 0x7f0b2c19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.022+0000 7f0b2b7fe640 1 -- 172.21.15.162:0/1511199334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b2c197910 msgr2=0x7f0b2c19ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b2b7fe640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b2c197910 0x7f0b2c19ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b2b7fe640 1 -- 172.21.15.162:0/1511199334 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c19f350 con 0x7f0b2c1005f0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b2bfff640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b2c197910 0x7f0b2c19ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b2b7fe640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c196f50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c006010 tx=0x7f0b1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c03f030 con 0x7f0b2c1005f0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b1c003cb0 con 0x7f0b2c1005f0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c19f5e0 con 0x7f0b2c1005f0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c035070 con 0x7f0b2c1005f0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.023+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c19fb40 con 0x7f0b2c1005f0 2024-09-19T08:37:11.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.024+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0b1c042030 con 0x7f0b2c1005f0 2024-09-19T08:37:11.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.024+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c19fda0 con 0x7f0b2c1005f0 2024-09-19T08:37:11.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.024+0000 7f0b28ff9640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0b14039730 0x7f0b1403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.024+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b1c06d200 con 0x7f0b2c1005f0 2024-09-19T08:37:11.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.024+0000 7f0b2affd640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0b14039730 0x7f0b1403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.025+0000 7f0b2affd640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0b14039730 0x7f0b1403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c198470 tx=0x7f0b20009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:11.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.029+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b1c03bd10 con 0x7f0b2c1005f0 2024-09-19T08:37:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T08:37:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: Updating smithi150:/etc/ceph/ceph.conf 2024-09-19T08:37:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: Updating smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: Updating smithi150:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: Updating smithi018:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:11.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.208+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi150=y;smithi162=z", "target": ["mon-mgr", ""]}) -- 0x7f0b2c062630 con 0x7f0b14039730 2024-09-19T08:37:11.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.212+0000 7f0b28ff9640 1 -- 172.21.15.162:0/1511199334 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0b2c062630 con 0x7f0b14039730 2024-09-19T08:37:11.212 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0b14039730 msgr2=0x7f0b1403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0b14039730 0x7f0b1403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c198470 tx=0x7f0b20009190 comp rx=0 tx=0).stop 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 msgr2=0x7f0b2c196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c196f50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c006010 tx=0x7f0b1c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 shutdown_connections 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0b14039730 0x7f0b1403bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b2c197910 0x7f0b2c19ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b2c197490 0x7f0b2c19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 --2- 172.21.15.162:0/1511199334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b2c1005f0 0x7f0b2c196f50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 >> 172.21.15.162:0/1511199334 conn(0x7f0b2c0fbda0 msgr2=0x7f0b2c06ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:11.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 shutdown_connections 2024-09-19T08:37:11.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:37:11.215+0000 7f0b31b80640 1 -- 172.21.15.162:0/1511199334 wait complete. 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: Reconfiguring mon.a (monmap changed)... 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: Reconfiguring daemon mon.a on smithi018 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:11.810 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:11.811 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:11.811 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.812 DEBUG:teuthology.orchestra.run.smithi150:mgr.y> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:37:11.814 DEBUG:teuthology.orchestra.run.smithi162:mgr.z> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:37:11.817 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:37:11.817 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:37:11.818 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:37:11.838 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:37:11.838 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-19T08:37:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:37:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:11.898 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:37:11.898 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:11.898 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:11.898 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 08:36:29.273776272 +0000 2024-09-19T08:37:11.899 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 08:31:46.984087566 +0000 2024-09-19T08:37:11.899 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 08:31:46.984087566 +0000 2024-09-19T08:37:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 08:31:46.984087566 +0000 2024-09-19T08:37:11.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:37:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: Reconfiguring mon.a (monmap changed)... 2024-09-19T08:37:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: Reconfiguring daemon mon.a on smithi018 2024-09-19T08:37:11.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:11.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:11.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:11.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: Reconfiguring mon.a (monmap changed)... 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.a on smithi018 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:11.968 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T08:37:11.968 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T08:37:11.968 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000131609 s, 3.9 MB/s 2024-09-19T08:37:11.969 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:37:12.029 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-19T08:37:12.087 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 08:36:29.303775925 +0000 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 08:31:47.302083842 +0000 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 08:31:47.302083842 +0000 2024-09-19T08:37:12.088 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 08:31:47.302083842 +0000 2024-09-19T08:37:12.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:37:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T08:37:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T08:37:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000122579 s, 4.2 MB/s 2024-09-19T08:37:12.157 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:37:12.217 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-19T08:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T08:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:12.276 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 08:36:29.335775555 +0000 2024-09-19T08:37:12.276 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 08:31:47.622080094 +0000 2024-09-19T08:37:12.276 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 08:31:47.622080094 +0000 2024-09-19T08:37:12.276 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 08:31:47.622080094 +0000 2024-09-19T08:37:12.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:37:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T08:37:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T08:37:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000116373 s, 4.4 MB/s 2024-09-19T08:37:12.343 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:37:12.402 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 08:36:29.365775209 +0000 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 08:31:47.962076112 +0000 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 08:31:47.962076112 +0000 2024-09-19T08:37:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 08:31:47.962076112 +0000 2024-09-19T08:37:12.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:37:12.530 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T08:37:12.530 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T08:37:12.530 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000115792 s, 4.4 MB/s 2024-09-19T08:37:12.531 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:37:12.590 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-19T08:37:12.590 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:37:12.606 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:37:12.606 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-19T08:37:12.661 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:37:12.661 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:12.661 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T08:37:12.661 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:12.662 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:12.662 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-19 08:37:02.011123851 +0000 2024-09-19T08:37:12.662 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-19 08:31:43.809627279 +0000 2024-09-19T08:37:12.662 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-19 08:31:43.809627279 +0000 2024-09-19T08:37:12.662 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-19 08:31:43.809627279 +0000 2024-09-19T08:37:12.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:37:12.723 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: Reconfiguring daemon mon.b on smithi150 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi150=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: Saving service mgr spec with placement smithi018=x;smithi150=y;smithi162=z;count:3 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:12.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:12.725 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-19T08:37:12.725 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-19T08:37:12.725 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.00020539 s, 2.5 MB/s 2024-09-19T08:37:12.726 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:37:12.783 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-19T08:37:12.839 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:37:12.840 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:12.840 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T08:37:12.840 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:12.840 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:12.841 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-19 08:37:02.011123851 +0000 2024-09-19T08:37:12.841 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-19 08:31:44.135621044 +0000 2024-09-19T08:37:12.841 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-19 08:31:44.135621044 +0000 2024-09-19T08:37:12.841 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-19 08:31:44.135621044 +0000 2024-09-19T08:37:12.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:37:12.903 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-19T08:37:12.903 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-19T08:37:12.903 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000197358 s, 2.6 MB/s 2024-09-19T08:37:12.904 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:37:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:37:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: Reconfiguring daemon mon.b on smithi150 2024-09-19T08:37:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi150=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: Saving service mgr spec with placement smithi018=x;smithi150=y;smithi162=z;count:3 2024-09-19T08:37:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:12.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:12.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:12.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:12.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:37:12.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.b on smithi150 2024-09-19T08:37:12.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi150=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:12.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: Saving service mgr spec with placement smithi018=x;smithi150=y;smithi162=z;count:3 2024-09-19T08:37:12.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:12.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:12.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:37:12.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:37:12.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:12.961 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-19T08:37:13.017 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:37:13.017 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:13.017 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:37:13.017 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:13.017 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:13.018 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-19 08:37:02.011123851 +0000 2024-09-19T08:37:13.018 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-19 08:31:44.459614846 +0000 2024-09-19T08:37:13.018 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-19 08:31:44.459614846 +0000 2024-09-19T08:37:13.018 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-19 08:31:44.459614846 +0000 2024-09-19T08:37:13.018 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:37:13.081 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-19T08:37:13.081 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-19T08:37:13.081 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000202754 s, 2.5 MB/s 2024-09-19T08:37:13.082 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:37:13.139 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-19T08:37:13.195 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:37:13.195 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:13.195 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T08:37:13.195 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:13.195 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:13.195 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-19 08:37:02.012123831 +0000 2024-09-19T08:37:13.196 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-19 08:31:44.821607922 +0000 2024-09-19T08:37:13.196 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-19 08:31:44.821607922 +0000 2024-09-19T08:37:13.196 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-19 08:31:44.821607922 +0000 2024-09-19T08:37:13.196 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:37:13.259 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-19T08:37:13.259 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-19T08:37:13.259 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000222002 s, 2.3 MB/s 2024-09-19T08:37:13.260 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:37:13.317 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T08:37:13.317 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:37:13.333 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:37:13.334 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-19T08:37:13.389 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 08:36:52.861903667 +0000 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 08:31:45.560340174 +0000 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 08:31:45.560340174 +0000 2024-09-19T08:37:13.390 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 08:31:45.560340174 +0000 2024-09-19T08:37:13.390 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:37:13.455 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T08:37:13.455 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T08:37:13.455 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00021407 s, 2.4 MB/s 2024-09-19T08:37:13.456 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:37:13.513 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 08:36:52.861903667 +0000 2024-09-19T08:37:13.569 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 08:31:45.891334227 +0000 2024-09-19T08:37:13.570 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 08:31:45.891334227 +0000 2024-09-19T08:37:13.570 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 08:31:45.891334227 +0000 2024-09-19T08:37:13.570 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:37:13.633 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T08:37:13.634 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T08:37:13.634 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000172999 s, 3.0 MB/s 2024-09-19T08:37:13.635 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:37:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:13 smithi162 ceph-mon[34870]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:13 smithi162 ceph-mon[34870]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:37:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:13 smithi162 ceph-mon[34870]: Reconfiguring daemon mon.c on smithi162 2024-09-19T08:37:13.683 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 08:36:52.862903648 +0000 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 08:31:46.226328208 +0000 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 08:31:46.226328208 +0000 2024-09-19T08:37:13.740 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 08:31:46.226328208 +0000 2024-09-19T08:37:13.741 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:37:13.803 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T08:37:13.803 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T08:37:13.803 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000203951 s, 2.5 MB/s 2024-09-19T08:37:13.804 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:37:13.860 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-19T08:37:13.917 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:37:13.917 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 08:36:52.862903648 +0000 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 08:31:46.540322566 +0000 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 08:31:46.540322566 +0000 2024-09-19T08:37:13.918 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 08:31:46.540322566 +0000 2024-09-19T08:37:13.918 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:37:13.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:13 smithi018 ceph-mon[30956]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:13 smithi018 ceph-mon[30956]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:37:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:13 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.c on smithi162 2024-09-19T08:37:13.982 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T08:37:13.982 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T08:37:13.982 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000176147 s, 2.9 MB/s 2024-09-19T08:37:13.983 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:37:14.041 INFO:tasks.cephadm:Deploying osd.0 on smithi018 with /dev/vg_nvme/lv_4... 2024-09-19T08:37:14.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:37:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:13 smithi150 ceph-mon[34610]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:13 smithi150 ceph-mon[34610]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:37:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:13 smithi150 ceph-mon[34610]: Reconfiguring daemon mon.c on smithi162 2024-09-19T08:37:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:37:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:37:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: Deploying daemon mgr.z on smithi162 2024-09-19T08:37:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:14 smithi018 ceph-mon[30956]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:14.974 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:14.975 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: Deploying daemon mgr.z on smithi162 2024-09-19T08:37:14.975 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:14 smithi162 ceph-mon[34870]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:15.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:15.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:15.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:15.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:15.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:15.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: Deploying daemon mgr.z on smithi162 2024-09-19T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:14 smithi150 ceph-mon[34610]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:15.631 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 systemd[1]: Starting Ceph mgr.z for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:37:15.895 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 podman[36657]: 2024-09-19 08:37:15.534557981 +0000 UTC m=+0.015943973 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:37:15.895 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 podman[36657]: 2024-09-19 08:37:15.643244914 +0000 UTC m=+0.124630891 container create 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T08:37:15.895 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 podman[36657]: 2024-09-19 08:37:15.837111326 +0000 UTC m=+0.318497314 container init 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T08:37:15.895 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 podman[36657]: 2024-09-19 08:37:15.840209429 +0000 UTC m=+0.321595415 container start 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T08:37:15.895 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 ceph-mgr[36676]: -- 172.21.15.162:0/421300976 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bc57eb0e0 con 0x559bc57c9400 2024-09-19T08:37:15.895 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 bash[36657]: 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc 2024-09-19T08:37:16.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 systemd[1]: Started Ceph mgr.z for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:37:16.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:15 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:15.964+0000 7fc4be665040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:37:16.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.023+0000 7fc4be665040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:37:16.522 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.170+0000 7fc4be665040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:37:16.522 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.236+0000 7fc4be665040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:37:16.523 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.383+0000 7fc4be665040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:37:16.523 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.522+0000 7fc4be665040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:37:16.556 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:37:16.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-09-19T08:37:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.835+0000 7fc4be665040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:16.895+0000 7fc4be665040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:17 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:17.080+0000 7fc4be665040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:17.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:37:17.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:17.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:17.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:16 smithi162 ceph-mon[34870]: Deploying daemon mgr.y on smithi150 2024-09-19T08:37:17.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:17.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:17.253 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:37:17.253 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:17.253 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:17.253 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:16 smithi150 ceph-mon[34610]: Deploying daemon mgr.y on smithi150 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:17.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:16 smithi018 ceph-mon[30956]: Deploying daemon mgr.y on smithi150 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 -- 172.21.15.18:0/3934781768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40107960 msgr2=0x7f4a40109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 --2- 172.21.15.18:0/3934781768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40107960 0x7f4a40109d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009ca0 tx=0x7f4a3802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 -- 172.21.15.18:0/3934781768 shutdown_connections 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 --2- 172.21.15.18:0/3934781768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40107960 0x7f4a40109d50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 --2- 172.21.15.18:0/3934781768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a40105030 0x7f4a40107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 --2- 172.21.15.18:0/3934781768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a40102700 0x7f4a40104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 -- 172.21.15.18:0/3934781768 >> 172.21.15.18:0/3934781768 conn(0x7f4a400fc280 msgr2=0x7f4a400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 -- 172.21.15.18:0/3934781768 shutdown_connections 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.259+0000 7f4a45b89640 1 -- 172.21.15.18:0/3934781768 wait complete. 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 Processor -- start 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 -- start start 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 0x7f4a40102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a40105030 0x7f4a401006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a40107960 0x7f4a40100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4010d730 con 0x7f4a40102700 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4010d5b0 con 0x7f4a40107960 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.260+0000 7f4a45b89640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4010d8b0 con 0x7f4a40105030 2024-09-19T08:37:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 0x7f4a40102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 0x7f4a40102060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51730/0 (socket says 172.21.15.18:51730) 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 -- 172.21.15.18:0/665648025 learned_addr learned my addr 172.21.15.18:0/665648025 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3ffff640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a40107960 0x7f4a40100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3effd640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a40105030 0x7f4a401006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 -- 172.21.15.18:0/665648025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a40105030 msgr2=0x7f4a401006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a40105030 0x7f4a401006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 -- 172.21.15.18:0/665648025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a40107960 msgr2=0x7f4a40100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a40107960 0x7f4a40100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 -- 172.21.15.18:0/665648025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a401014b0 con 0x7f4a40102700 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3f7fe640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 0x7f4a40102060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000e9f0 tx=0x7f4a3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000cd80 con 0x7f4a40102700 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a300054d0 con 0x7f4a40102700 2024-09-19T08:37:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a401a1fb0 con 0x7f4a40102700 2024-09-19T08:37:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30010490 con 0x7f4a40102700 2024-09-19T08:37:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.261+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a401a2350 con 0x7f4a40102700 2024-09-19T08:37:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.262+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4a30010710 con 0x7f4a40102700 2024-09-19T08:37:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.262+0000 7f4a3cff9640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a280394d0 0x7f4a2803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.262+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4a3004daa0 con 0x7f4a40102700 2024-09-19T08:37:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.262+0000 7f4a3effd640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a280394d0 0x7f4a2803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.263+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a40105410 con 0x7f4a40102700 2024-09-19T08:37:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.263+0000 7f4a3effd640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a280394d0 0x7f4a2803b990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4a40101de0 tx=0x7f4a34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.268+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a300203a0 con 0x7f4a40102700 2024-09-19T08:37:17.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:17.451+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4a400626f0 con 0x7f4a280394d0 2024-09-19T08:37:18.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:17 smithi018 ceph-mon[30956]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:18.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:18.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:18.177 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:18.251 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:17 smithi150 ceph-mon[34610]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:18.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:18.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:18.252 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:18.252 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:18.192+0000 7f435cde9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:37:18.252 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:18.251+0000 7f435cde9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:37:18.417 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:17 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:17.961+0000 7fc4be665040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:37:18.417 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:18.029+0000 7fc4be665040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:37:18.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:17 smithi162 ceph-mon[34870]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:18.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:18.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:18.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:18.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:18.407+0000 7f435cde9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:37:18.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:18.477+0000 7f435cde9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:37:18.896 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:18.638+0000 7f435cde9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:37:18.896 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:18.788+0000 7f435cde9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:37:19.046 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:18.782+0000 7fc4be665040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:37:19.046 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:18.898+0000 7fc4be665040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:37:19.046 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.045+0000 7fc4be665040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:37:19.175 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:19.113+0000 7f435cde9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:37:19.175 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:19.175+0000 7f435cde9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:37:19.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:19 smithi018 ceph-mon[30956]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:19.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:19.328 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.110+0000 7fc4be665040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:37:19.328 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.260+0000 7fc4be665040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:37:19.328 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.328+0000 7fc4be665040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:37:19.329 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-mon[34870]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:19.329 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.329 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.329 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.329 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.329 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:19.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:19.368+0000 7f435cde9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:37:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-mon[34610]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:19.625 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.390+0000 7fc4be665040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:37:19.625 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.559+0000 7fc4be665040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:37:19.625 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.625+0000 7fc4be665040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:37:19.890 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.691+0000 7fc4be665040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:37:19.890 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.772+0000 7fc4be665040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:37:19.890 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.832+0000 7fc4be665040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:37:19.890 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:19.890+0000 7fc4be665040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:37:20.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:20.250+0000 7f435cde9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:37:20.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:20.317+0000 7f435cde9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: Reconfiguring daemon mgr.x on smithi018 2024-09-19T08:37:20.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2464682922' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bb67065-1994-4aa0-92e0-3777a2054efe"}]: dispatch 2024-09-19T08:37:20.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2464682922' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bb67065-1994-4aa0-92e0-3777a2054efe"}]': finished 2024-09-19T08:37:20.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:37:20.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:20.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:20 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/562190050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: Reconfiguring daemon mgr.x on smithi018 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2464682922' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bb67065-1994-4aa0-92e0-3777a2054efe"}]: dispatch 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2464682922' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bb67065-1994-4aa0-92e0-3777a2054efe"}]': finished 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:20.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/562190050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:37:20.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: Reconfiguring daemon mgr.x on smithi018 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2464682922' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bb67065-1994-4aa0-92e0-3777a2054efe"}]: dispatch 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2464682922' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bb67065-1994-4aa0-92e0-3777a2054efe"}]': finished 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:20.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/562190050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:21.167 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:37:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z[36672]: 2024-09-19T08:37:20.679+0000 7fc4be665040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:37:21.286 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.031+0000 7f435cde9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:37:21.286 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.144+0000 7f435cde9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:37:21.286 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.286+0000 7f435cde9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:37:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:21.463+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f4a30021960 con 0x7f4a40102700 2024-09-19T08:37:21.564 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-mon[34610]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-mon[34610]: Standby manager daemon z started 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.347+0000 7f435cde9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.496+0000 7f435cde9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:37:21.565 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.564+0000 7f435cde9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:37:21.815 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.625+0000 7f435cde9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:37:21.815 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.781+0000 7f435cde9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:37:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:21 smithi162 ceph-mon[34870]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:21 smithi162 ceph-mon[34870]: Standby manager daemon z started 2024-09-19T08:37:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:21 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:37:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:21 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:21 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:37:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:21 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:21.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:21 smithi018 ceph-mon[30956]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:21.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:21 smithi018 ceph-mon[30956]: Standby manager daemon z started 2024-09-19T08:37:21.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:21 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:37:21.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:21 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:21.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:21 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:37:21.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:21 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/333952475' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:22.111 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.847+0000 7f435cde9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:37:22.111 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.912+0000 7f435cde9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:37:22.111 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:21.993+0000 7f435cde9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:37:22.111 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:22.052+0000 7f435cde9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:37:22.111 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:22.111+0000 7f435cde9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:37:22.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:22 smithi150 ceph-mon[34610]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:37:22.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:37:22.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:22 smithi162 ceph-mon[34870]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:37:22.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:37:22.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:22 smithi018 ceph-mon[30956]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:37:22.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:37:23.315 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:37:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y[35978]: 2024-09-19T08:37:22.892+0000 7f435cde9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:37:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:23.812+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f4a3001b160 con 0x7f4a40102700 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: Standby manager daemon y started 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:37:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:23 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: Standby manager daemon y started 2024-09-19T08:37:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:37:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:37:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:23 smithi150 ceph-mon[34610]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: Standby manager daemon y started 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:37:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:23 smithi162 ceph-mon[34870]: from='mgr.? 172.21.15.150:0/51506332' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:24.914 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:24 smithi018 ceph-mon[30956]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:24.915 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:24 smithi018 ceph-mon[30956]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:37:24.915 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:37:25.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:24 smithi150 ceph-mon[34610]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:25.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:24 smithi150 ceph-mon[34610]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:37:25.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:24 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:37:25.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:24 smithi162 ceph-mon[34870]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:25.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:24 smithi162 ceph-mon[34870]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:37:25.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:24 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:37:27.009 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:26 smithi018 ceph-mon[30956]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:27.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:27.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:27.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:27.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:26 smithi150 ceph-mon[34610]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:27.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:27.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:27.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:27.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:26 smithi162 ceph-mon[34870]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:27.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:27.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:27.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:28.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:28.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:28.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:27 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:27 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:27 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:28.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:27 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:28.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:27 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:28.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:27 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:29 smithi018 ceph-mon[30956]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:37:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:29.868 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:29 smithi150 ceph-mon[34610]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:29.868 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:37:29.868 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:29.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:29 smithi162 ceph-mon[34870]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:29.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:37:29.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:30.649 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:30 smithi018 ceph-mon[30956]: Deploying daemon osd.0 on smithi018 2024-09-19T08:37:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:30 smithi162 ceph-mon[34870]: Deploying daemon osd.0 on smithi018 2024-09-19T08:37:31.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:30 smithi150 ceph-mon[34610]: Deploying daemon osd.0 on smithi018 2024-09-19T08:37:31.779 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:31 smithi018 ceph-mon[30956]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:31 smithi162 ceph-mon[34870]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:31 smithi150 ceph-mon[34610]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:33.869 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:33 smithi018 ceph-mon[30956]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:33 smithi162 ceph-mon[34870]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:33 smithi150 ceph-mon[34610]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:35 smithi162 ceph-mon[34870]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:35.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:35 smithi018 ceph-mon[30956]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:35.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:35.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:35.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:36.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:35 smithi150 ceph-mon[34610]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:36.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:36.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:36.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:37.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:37 smithi018 ceph-mon[30956]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:37.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:37.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:37.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:37.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:37.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:37 smithi162 ceph-mon[34870]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:37 smithi150 ceph-mon[34610]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:38.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:38.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:38.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:38.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.571+0000 7f4a3cff9640 1 -- 172.21.15.18:0/665648025 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4a400626f0 con 0x7f4a280394d0 2024-09-19T08:37:39.573 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 0 on host 'smithi018' 2024-09-19T08:37:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.574+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a280394d0 msgr2=0x7f4a2803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.574+0000 7f4a45b89640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a280394d0 0x7f4a2803b990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4a40101de0 tx=0x7f4a34005f90 comp rx=0 tx=0).stop 2024-09-19T08:37:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.574+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 msgr2=0x7f4a40102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.574+0000 7f4a45b89640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 0x7f4a40102060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000e9f0 tx=0x7f4a3000edf0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 shutdown_connections 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f4a280394d0 0x7f4a2803b990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a40107960 0x7f4a40100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a40105030 0x7f4a401006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 --2- 172.21.15.18:0/665648025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40102700 0x7f4a40102060 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 >> 172.21.15.18:0/665648025 conn(0x7f4a400fc280 msgr2=0x7f4a401031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 shutdown_connections 2024-09-19T08:37:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:37:39.575+0000 7f4a45b89640 1 -- 172.21.15.18:0/665648025 wait complete. 2024-09-19T08:37:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:39 smithi162 ceph-mon[34870]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:39.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:39 smithi018 ceph-mon[30956]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:39.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:39.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:39.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:39 smithi150 ceph-mon[34610]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:40.246 DEBUG:teuthology.orchestra.run.smithi018:osd.0> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:37:40.249 INFO:tasks.cephadm:Deploying osd.1 on smithi150 with /dev/vg_nvme/lv_4... 2024-09-19T08:37:40.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:37:40.486 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:37:40.944 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:37:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0[45134]: 2024-09-19T08:37:40.679+0000 7fd9292a5640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:37:41.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:41 smithi018 ceph-mon[30956]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:41.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:41 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:37:41.789 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:41 smithi150 ceph-mon[34610]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:41.789 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:41 smithi150 ceph-mon[34610]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:37:41.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:41 smithi162 ceph-mon[34870]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:41.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:41 smithi162 ceph-mon[34870]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:37:42.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:42 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:37:42.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:42 smithi018 ceph-mon[30956]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:37:42.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:42 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:37:42.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:42.833 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:37:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0[45134]: 2024-09-19T08:37:42.623+0000 7fd925228640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:37:42.833 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:37:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0[45134]: 2024-09-19T08:37:42.626+0000 7fd921050640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:42.882 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:42 smithi150 ceph-mon[34610]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:37:42.883 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:42 smithi150 ceph-mon[34610]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:37:42.883 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:42 smithi150 ceph-mon[34610]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:37:42.883 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:42 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:37:42.911 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_4 2024-09-19T08:37:42.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:42 smithi162 ceph-mon[34870]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:37:42.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:42 smithi162 ceph-mon[34870]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:37:42.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:42 smithi162 ceph-mon[34870]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:37:42.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:42 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:43.162 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:37:43.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 -- 172.21.15.150:0/804267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 msgr2=0x7f10c4104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:43.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 --2- 172.21.15.150:0/804267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4104a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009900 tx=0x7f10b402a410 comp rx=0 tx=0).stop 2024-09-19T08:37:43.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 -- 172.21.15.150:0/804267819 shutdown_connections 2024-09-19T08:37:43.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 --2- 172.21.15.150:0/804267819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4107900 0x7f10c4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:43.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 --2- 172.21.15.150:0/804267819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c4104fd0 0x7f10c41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:43.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 --2- 172.21.15.150:0/804267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4104a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:43.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 -- 172.21.15.150:0/804267819 >> 172.21.15.150:0/804267819 conn(0x7f10c40fc2a0 msgr2=0x7f10c40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:43.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 -- 172.21.15.150:0/804267819 shutdown_connections 2024-09-19T08:37:43.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.603+0000 7f10c89d0640 1 -- 172.21.15.150:0/804267819 wait complete. 2024-09-19T08:37:43.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 Processor -- start 2024-09-19T08:37:43.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 -- start start 2024-09-19T08:37:43.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:43.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4104fd0 0x7f10c41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:43.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c4107900 0x7f10c419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:43.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10c410d820 con 0x7f10c4104fd0 2024-09-19T08:37:43.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:43.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f10c410d6a0 con 0x7f10c41026a0 2024-09-19T08:37:43.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c89d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10c410d9a0 con 0x7f10c4107900 2024-09-19T08:37:43.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35732/0 (socket says 172.21.15.150:35732) 2024-09-19T08:37:43.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 -- 172.21.15.150:0/3760214552 learned_addr learned my addr 172.21.15.150:0/3760214552 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-19T08:37:43.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c2d9d640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c4107900 0x7f10c419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c1d9b640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4104fd0 0x7f10c41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 -- 172.21.15.150:0/3760214552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c4107900 msgr2=0x7f10c419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c4107900 0x7f10c419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 -- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4104fd0 msgr2=0x7f10c41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.604+0000 7f10c259c640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4104fd0 0x7f10c41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10c259c640 1 -- 172.21.15.150:0/3760214552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c419fb90 con 0x7f10c41026a0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10c259c640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4197f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10b40314e0 tx=0x7f10b4003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b403f070 con 0x7f10c41026a0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10b4031e40 con 0x7f10c41026a0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4035030 con 0x7f10c41026a0 2024-09-19T08:37:43.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c419fe20 con 0x7f10c41026a0 2024-09-19T08:37:43.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.605+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c41a0270 con 0x7f10c41026a0 2024-09-19T08:37:43.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.606+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c40fdd90 con 0x7f10c41026a0 2024-09-19T08:37:43.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.607+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f10b4042070 con 0x7f10c41026a0 2024-09-19T08:37:43.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.608+0000 7f10b37fe640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10ac0a3260 0x7f10ac0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:43.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.608+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f10b40ee4f0 con 0x7f10c41026a0 2024-09-19T08:37:43.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.608+0000 7f10c1d9b640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10ac0a3260 0x7f10ac0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:43.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.608+0000 7f10c1d9b640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10ac0a3260 0x7f10ac0a5720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10c4199480 tx=0x7f10b8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:43.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.612+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10b40bcda0 con 0x7f10c41026a0 2024-09-19T08:37:43.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:37:43.790+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f10c4062630 con 0x7f10ac0a3260 2024-09-19T08:37:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:37:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:37:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:43.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:43.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:43.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:43.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:43.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:37:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:37:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:44.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:37:44.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:37:44.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi018 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] boot 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:44.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:44 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi018 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] boot 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:44.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:44.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:44 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: osd.0 [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] boot 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:45.787 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:45 smithi150 ceph-mon[34610]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:45.787 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:45 smithi150 ceph-mon[34610]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:45.787 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:45 smithi150 ceph-mon[34610]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:37:45.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:45 smithi162 ceph-mon[34870]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:45.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:45 smithi162 ceph-mon[34870]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:45.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:45 smithi162 ceph-mon[34870]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:37:45.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:45 smithi018 ceph-mon[30956]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:45.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:45 smithi018 ceph-mon[30956]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:45.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:45 smithi018 ceph-mon[30956]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:37:46.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:46 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/2348570112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]: dispatch 2024-09-19T08:37:46.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:46 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]: dispatch 2024-09-19T08:37:46.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:46 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]': finished 2024-09-19T08:37:46.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:46 smithi162 ceph-mon[34870]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:37:46.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:46 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:46 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/2348570112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]: dispatch 2024-09-19T08:37:46.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:46 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]: dispatch 2024-09-19T08:37:46.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:46 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]': finished 2024-09-19T08:37:46.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:46 smithi018 ceph-mon[30956]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:37:46.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:46 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/2348570112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]: dispatch 2024-09-19T08:37:47.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:46 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]: dispatch 2024-09-19T08:37:47.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:46 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bbf03fb-7094-4991-a237-e388fbb0d949"}]': finished 2024-09-19T08:37:47.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:46 smithi150 ceph-mon[34610]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:37:47.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:46 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:47 smithi162 ceph-mon[34870]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:47 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/167354504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:47.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:47 smithi018 ceph-mon[30956]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:47.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/167354504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:47 smithi150 ceph-mon[34610]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:47 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/167354504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:49 smithi162 ceph-mon[34870]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:49.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:49 smithi018 ceph-mon[30956]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:50.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:49 smithi150 ceph-mon[34610]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:51.841 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:51 smithi150 ceph-mon[34610]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:51 smithi162 ceph-mon[34870]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:51.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:51 smithi018 ceph-mon[30956]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:53.729 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:53 smithi150 ceph-mon[34610]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:53.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:53 smithi162 ceph-mon[34870]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:53.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:53 smithi018 ceph-mon[30956]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:37:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:54.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:37:54.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:54.982 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:37:54.983 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:55.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:55 smithi162 ceph-mon[34870]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:55 smithi162 ceph-mon[34870]: Deploying daemon osd.1 on smithi150 2024-09-19T08:37:55.928 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:55 smithi150 ceph-mon[34610]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:55.928 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:55 smithi150 ceph-mon[34610]: Deploying daemon osd.1 on smithi150 2024-09-19T08:37:55.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:55 smithi018 ceph-mon[30956]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:55 smithi018 ceph-mon[30956]: Deploying daemon osd.1 on smithi150 2024-09-19T08:37:57.780 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:57 smithi150 ceph-mon[34610]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:57.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:57 smithi162 ceph-mon[34870]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:57.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:57 smithi018 ceph-mon[30956]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:37:59 smithi162 ceph-mon[34870]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:59.942 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:37:59 smithi150 ceph-mon[34610]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:59.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:37:59 smithi018 ceph-mon[30956]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:00.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:00.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:00.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:00.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:00.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:00.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:00.981 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:00.981 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:00.981 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:01 smithi162 ceph-mon[34870]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:01.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:01 smithi018 ceph-mon[30956]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:01 smithi150 ceph-mon[34610]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:03.895 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:03 smithi150 ceph-mon[34610]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:03.895 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:03 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.895 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:03 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.895 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:03 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:03.895 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:03 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:03.895 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:03 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:03 smithi162 ceph-mon[34870]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:03 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:03 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:03 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:03 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:03 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:03 smithi018 ceph-mon[30956]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:04.220 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.219+0000 7f10b37fe640 1 -- 172.21.15.150:0/3760214552 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10c4062630 con 0x7f10ac0a3260 2024-09-19T08:38:04.220 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 1 on host 'smithi150' 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10ac0a3260 msgr2=0x7f10ac0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10ac0a3260 0x7f10ac0a5720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10c4199480 tx=0x7f10b8009110 comp rx=0 tx=0).stop 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 msgr2=0x7f10c4197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4197f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10b40314e0 tx=0x7f10b4003c80 comp rx=0 tx=0).stop 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 shutdown_connections 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10ac0a3260 0x7f10ac0a5720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c4107900 0x7f10c419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4104fd0 0x7f10c41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 --2- 172.21.15.150:0/3760214552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10c41026a0 0x7f10c4197f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 >> 172.21.15.150:0/3760214552 conn(0x7f10c40fc2a0 msgr2=0x7f10c4104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 shutdown_connections 2024-09-19T08:38:04.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:04.222+0000 7f10c89d0640 1 -- 172.21.15.150:0/3760214552 wait complete. 2024-09-19T08:38:04.824 DEBUG:teuthology.orchestra.run.smithi150:osd.1> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:38:04.826 INFO:tasks.cephadm:Deploying osd.2 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-19T08:38:04.827 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:38:04.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:04.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:04.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:04.955 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:04.955 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:04.956 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:05.079 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:38:05.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:05.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:05.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:05 smithi162 ceph-mon[34870]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:05.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:05 smithi018 ceph-mon[30956]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:05 smithi150 ceph-mon[34610]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:06.671 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:06 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1[39063]: 2024-09-19T08:38:06.324+0000 7fa7463b0640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:38:06.932 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:06 smithi150 ceph-mon[34610]: from='osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:38:06.932 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:06 smithi150 ceph-mon[34610]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:38:06.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:06 smithi018 ceph-mon[30956]: from='osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:38:06.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:06 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:38:07.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:06 smithi162 ceph-mon[34870]: from='osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:38:07.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:06 smithi162 ceph-mon[34870]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:38:07.408 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:38:07.436 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-19T08:38:07.694 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:38:07.717 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:07.717 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:38:07.717 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:38:07.717 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:07.717 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:07.718 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:07.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:08.065 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1[39063]: 2024-09-19T08:38:07.687+0000 7fa742333640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:38:08.065 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1[39063]: 2024-09-19T08:38:07.690+0000 7fa73e15b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:38:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:08.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/426429358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 msgr2=0x7f5ec8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/426429358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec8102150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009900 tx=0x7f5ebc02a410 comp rx=0 tx=0).stop 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/426429358 shutdown_connections 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/426429358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec8102690 0x7f5ec8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/426429358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec8102150 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/426429358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8100ad0 0x7f5ec8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/426429358 >> 172.21.15.162:0/426429358 conn(0x7f5ec80fc280 msgr2=0x7f5ec80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/426429358 shutdown_connections 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.169+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/426429358 wait complete. 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 Processor -- start 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 -- start start 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec8100ad0 0x7f5ec806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8102690 0x7f5ec819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec810c630 con 0x7f5ec8100ad0 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec810c4b0 con 0x7f5ec8102690 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ecdd3c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec810c7b0 con 0x7f5ec8101cd0 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36786/0 (socket says 172.21.15.162:36786) 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ec6ffd640 1 -- 172.21.15.162:0/2482005592 learned_addr learned my addr 172.21.15.162:0/2482005592 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.170+0000 7f5ec7fff640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8102690 0x7f5ec819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec77fe640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec8100ad0 0x7f5ec806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec6ffd640 1 -- 172.21.15.162:0/2482005592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8102690 msgr2=0x7f5ec819f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec6ffd640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8102690 0x7f5ec819f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec6ffd640 1 -- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec8100ad0 msgr2=0x7f5ec806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec6ffd640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec8100ad0 0x7f5ec806ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec6ffd640 1 -- 172.21.15.162:0/2482005592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec819fa40 con 0x7f5ec8101cd0 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec7fff640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8102690 0x7f5ec819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec6ffd640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec819cb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0314e0 tx=0x7f5ebc003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc03f070 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec8196900 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ebc031e40 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc035030 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.171+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec8196e30 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.172+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec8107f90 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.173+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f5ebc042070 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.174+0000 7f5ec4ff9640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5eb00a31b0 0x7f5eb00a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.174+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f5ebc0eeed0 con 0x7f5ec8101cd0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.174+0000 7f5ec77fe640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5eb00a31b0 0x7f5eb00a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.175+0000 7f5ec77fe640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5eb00a31b0 0x7f5eb00a5670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8005fd0 tx=0x7f5eb8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.178+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ebc0bd560 con 0x7f5ec8101cd0 2024-09-19T08:38:08.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:08.355+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5ec8062630 con 0x7f5eb00a31b0 2024-09-19T08:38:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi150 2024-09-19T08:38:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi150 to 17088M 2024-09-19T08:38:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:38:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:38:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:08.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:08.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:08.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:08.977 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi150 2024-09-19T08:38:08.977 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi150 to 17088M 2024-09-19T08:38:08.977 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:38:08.977 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:38:08.978 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:08.978 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:08.978 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:08.978 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:08.978 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:08 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi150 2024-09-19T08:38:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi150 to 17088M 2024-09-19T08:38:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:38:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:38:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:09.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:08 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:09.983 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:38:09.983 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:38:09.983 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:09.983 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:09.984 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:09.984 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] boot 2024-09-19T08:38:09.984 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:38:09.984 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:38:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:38:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:10.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:10.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:10.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] boot 2024-09-19T08:38:10.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:38:10.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: osd.1 [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] boot 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:38:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:38:10.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:10 smithi162 ceph-mon[34870]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:38:10.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:10 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/531789999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]: dispatch 2024-09-19T08:38:10.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:10 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]: dispatch 2024-09-19T08:38:10.971 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:10 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]': finished 2024-09-19T08:38:10.971 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:10 smithi162 ceph-mon[34870]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:38:10.971 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:10 smithi150 ceph-mon[34610]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:38:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:10 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/531789999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]: dispatch 2024-09-19T08:38:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:10 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]: dispatch 2024-09-19T08:38:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:10 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]': finished 2024-09-19T08:38:11.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:10 smithi150 ceph-mon[34610]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:38:11.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:10 smithi018 ceph-mon[30956]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:38:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/531789999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]: dispatch 2024-09-19T08:38:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:10 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]: dispatch 2024-09-19T08:38:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:10 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6aeae03-d039-4b95-bdf4-7484fba94e91"}]': finished 2024-09-19T08:38:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:10 smithi018 ceph-mon[30956]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:38:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:11 smithi150 ceph-mon[34610]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:11 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/2429319359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:11 smithi162 ceph-mon[34870]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:11 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/2429319359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:12.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:11 smithi018 ceph-mon[30956]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:12.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:11 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/2429319359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:13 smithi150 ceph-mon[34610]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:14.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:13 smithi162 ceph-mon[34870]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:14.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:13 smithi018 ceph-mon[30956]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:15.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:14 smithi150 ceph-mon[34610]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:15.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:14 smithi162 ceph-mon[34870]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:15.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:14 smithi018 ceph-mon[30956]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:16.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:16 smithi162 ceph-mon[34870]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:17.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:16 smithi018 ceph-mon[30956]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:17.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:16 smithi150 ceph-mon[34610]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:18 smithi162 ceph-mon[34870]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:19.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:18 smithi018 ceph-mon[30956]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:19.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:18 smithi150 ceph-mon[34610]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:38:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:19 smithi162 ceph-mon[34870]: Deploying daemon osd.2 on smithi162 2024-09-19T08:38:20.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:38:20.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:20.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:19 smithi018 ceph-mon[30956]: Deploying daemon osd.2 on smithi162 2024-09-19T08:38:20.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:38:20.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:20.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:19 smithi150 ceph-mon[34610]: Deploying daemon osd.2 on smithi162 2024-09-19T08:38:21.105 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:20 smithi162 ceph-mon[34870]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:21.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:20 smithi018 ceph-mon[30956]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:21.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:20 smithi150 ceph-mon[34610]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:23.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:22 smithi162 ceph-mon[34870]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:23.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:22 smithi018 ceph-mon[30956]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:23.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:22 smithi150 ceph-mon[34610]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:25.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:24 smithi162 ceph-mon[34870]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:25.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:24 smithi018 ceph-mon[30956]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:25.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:24 smithi150 ceph-mon[34610]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:25.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:26.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:26.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:26.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:26.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:26.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:26.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:27.395 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:27 smithi162 ceph-mon[34870]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:27.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:27 smithi150 ceph-mon[34610]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:27.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:27 smithi018 ceph-mon[30956]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:28.823 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:28 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:28.824 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:28 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:28.824 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:28 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:28.824 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:28 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:28.824 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:28 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:28.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.865+0000 7f5ec4ff9640 1 -- 172.21.15.162:0/2482005592 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5ec8062630 con 0x7f5eb00a31b0 2024-09-19T08:38:28.865 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 2 on host 'smithi162' 2024-09-19T08:38:28.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5eb00a31b0 msgr2=0x7f5eb00a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:28.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5eb00a31b0 0x7f5eb00a5670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8005fd0 tx=0x7f5eb8005850 comp rx=0 tx=0).stop 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 msgr2=0x7f5ec819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec819cb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0314e0 tx=0x7f5ebc003c80 comp rx=0 tx=0).stop 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 shutdown_connections 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5eb00a31b0 0x7f5eb00a5670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ec8102690 0x7f5ec819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec8101cd0 0x7f5ec819cb30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 --2- 172.21.15.162:0/2482005592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec8100ad0 0x7f5ec806ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 >> 172.21.15.162:0/2482005592 conn(0x7f5ec80fc280 msgr2=0x7f5ec8105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 shutdown_connections 2024-09-19T08:38:28.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:38:28.867+0000 7f5ecdd3c640 1 -- 172.21.15.162:0/2482005592 wait complete. 2024-09-19T08:38:29.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:28 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:28 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:28 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:29.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:28 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:29.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:28 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:29.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:29.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.487 DEBUG:teuthology.orchestra.run.smithi162:osd.2> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:38:29.489 INFO:tasks.cephadm:Deploying osd.3 on smithi018 with /dev/vg_nvme/lv_3... 2024-09-19T08:38:29.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:38:29.728 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:29 smithi162 ceph-mon[34870]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:29.728 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:29.728 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.728 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.750 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:38:29.872 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:29 smithi018 ceph-mon[30956]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:29.872 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:29.872 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:29.873 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:29 smithi150 ceph-mon[34610]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:31.221 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2[39808]: 2024-09-19T08:38:30.986+0000 7f26700bb640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:38:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:31 smithi150 ceph-mon[34610]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:31 smithi150 ceph-mon[34610]: from='osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:31 smithi150 ceph-mon[34610]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:32.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:31 smithi018 ceph-mon[30956]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:32.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:31 smithi018 ceph-mon[30956]: from='osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:32.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:31 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:32.073 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:31 smithi162 ceph-mon[34870]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:32.073 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:31 smithi162 ceph-mon[34870]: from='osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:32.073 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:31 smithi162 ceph-mon[34870]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:38:32.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-09-19T08:38:32.679 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:38:32.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:38:32.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:38:32.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:32.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:38:32.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:38:32.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:32.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:32.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:32.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:32.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:32.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:32.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:33.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:33.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:33.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.167 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2[39808]: 2024-09-19T08:38:32.718+0000 7f266c03e640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:38:33.168 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2[39808]: 2024-09-19T08:38:32.721+0000 7f2667e66640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:38:33.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:38:33.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:38:33.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:33.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:38:33.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:38:33.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:33.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:33.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:33.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3046945182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 msgr2=0x7fe4a0108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3046945182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a0108f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe498009ca0 tx=0x7fe49802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3046945182 shutdown_connections 2024-09-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3046945182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a0108f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3046945182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 0x7fe4a0102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3046945182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4a0100af0 0x7fe4a0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3046945182 >> 172.21.15.18:0/3046945182 conn(0x7fe4a00fc2a0 msgr2=0x7fe4a00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3046945182 shutdown_connections 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3046945182 wait complete. 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 Processor -- start 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.176+0000 7fe4a52d8640 1 -- start start 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe4a52d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4a0100af0 0x7fe4a006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe4a52d8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 0x7fe4a019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe4a52d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a01a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe4a52d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a010c620 con 0x7fe4a01026b0 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe4a52d8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a010c4a0 con 0x7fe4a0101cf0 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe4a52d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a010c7a0 con 0x7fe4a0100af0 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a01a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a01a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51808/0 (socket says 172.21.15.18:51808) 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 -- 172.21.15.18:0/3626881254 learned_addr learned my addr 172.21.15.18:0/3626881254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49effd640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4a0100af0 0x7fe4a006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49e7fc640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 0x7fe4a019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 -- 172.21.15.18:0/3626881254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4a0100af0 msgr2=0x7fe4a006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4a0100af0 0x7fe4a006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 -- 172.21.15.18:0/3626881254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 msgr2=0x7fe4a019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 0x7fe4a019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 -- 172.21.15.18:0/3626881254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a01a1ca0 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49e7fc640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 0x7fe4a019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe49f7fe640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a01a14b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe498031970 tx=0x7fe498003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.177+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498004040 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.178+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe498004690 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.178+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a01a1ed0 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.178+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498030c60 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.178+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a01a23e0 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.179+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a0107f90 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.180+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fe4980041e0 con 0x7fe4a01026b0 2024-09-19T08:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.180+0000 7fe487fff640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe4880a31e0 0x7fe4880a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.181+0000 7fe49effd640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe4880a31e0 0x7fe4880a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.181+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fe4980ef6d0 con 0x7fe4a01026b0 2024-09-19T08:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.181+0000 7fe49effd640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe4880a31e0 0x7fe4880a56a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0101b50 tx=0x7fe490005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.185+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4980bdb40 con 0x7fe4a01026b0 2024-09-19T08:38:33.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:33.369+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe4a0062630 con 0x7fe4880a31e0 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:34.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:34.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi162 2024-09-19T08:38:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T08:38:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:34.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:33 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi162 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:34.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:34.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:34.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:33 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] boot 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:34.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:38:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:38:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] boot 2024-09-19T08:38:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:38:35.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:35.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:35.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: osd.2 [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] boot 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:35.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:35.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:35 smithi018 ceph-mon[30956]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:38:35.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:35 smithi150 ceph-mon[34610]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:38:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:36.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:36.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:35 smithi162 ceph-mon[34870]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:38:36.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:36.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49597]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:36.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49597]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:36.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:36.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49597]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:36.997 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:36.997 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:38:36.998 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:36.998 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2089729687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df42fcd-03dc-4b16-b8fb-f1d74227e211"}]: dispatch 2024-09-19T08:38:36.998 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2089729687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df42fcd-03dc-4b16-b8fb-f1d74227e211"}]': finished 2024-09-19T08:38:36.998 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:38:36.998 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:36.998 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:36 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1779131171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2089729687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df42fcd-03dc-4b16-b8fb-f1d74227e211"}]: dispatch 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2089729687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df42fcd-03dc-4b16-b8fb-f1d74227e211"}]': finished 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:36 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1779131171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:37.194 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49622]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:37.194 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49622]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:37.194 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:37.194 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:38:36 smithi018 sudo[49622]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:37.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:37.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:38:37.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2089729687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df42fcd-03dc-4b16-b8fb-f1d74227e211"}]: dispatch 2024-09-19T08:38:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2089729687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df42fcd-03dc-4b16-b8fb-f1d74227e211"}]': finished 2024-09-19T08:38:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:38:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1779131171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:37.252 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:36 smithi150 sudo[43178]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:37.252 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:36 smithi150 sudo[43178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:37.252 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:36 smithi150 sudo[43178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:37.252 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:37 smithi150 sudo[43178]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:37.565 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:37 smithi150 sudo[43181]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:37.565 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:37 smithi150 sudo[43181]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:37.565 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:37 smithi150 sudo[43181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:37.565 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:38:37 smithi150 sudo[43181]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:37.775 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:37.775 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:37.775 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43688]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:37.775 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43688]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:37.776 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:37.776 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43688]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:38.167 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43691]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:38.167 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43691]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:38.167 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:38.167 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:38:37 smithi162 sudo[43691]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:38.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:38.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50019]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:38.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50019]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:38.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:38.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50019]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50211]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50211]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:38 smithi018 sudo[50211]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:39.198 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:38 smithi162 sudo[43694]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:39.198 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:38 smithi162 sudo[43694]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:39.198 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:38 smithi162 sudo[43694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:39.198 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:38 smithi162 sudo[43694]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:39.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 sudo[43697]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:39.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 sudo[43697]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:39.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 sudo[43697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:39.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 sudo[43697]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:39.697 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43184]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:39.697 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43184]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:39.697 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:39.697 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43184]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:39.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:39.714+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe4980b9ab0 con 0x7fe4a01026b0 2024-09-19T08:38:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43187]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43187]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 sudo[43187]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.919 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:40.919 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:40.920 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:40.920 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:40.920 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:40.920 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:40.920 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:40.920 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:40 smithi018 ceph-mon[30956]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:38:41.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:41.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:41.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:41.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:41.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:41.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:41.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:41.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:40 smithi150 ceph-mon[34610]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:41.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:40 smithi162 ceph-mon[34870]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:38:41.998 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:41 smithi018 ceph-mon[30956]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:41 smithi150 ceph-mon[34610]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:41 smithi162 ceph-mon[34870]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:42.921 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:42 smithi018 ceph-mon[30956]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:43.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:42 smithi150 ceph-mon[34610]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:42 smithi162 ceph-mon[34870]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:45.089 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:44 smithi018 ceph-mon[30956]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:45.089 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:38:45.089 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:45.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:44 smithi018 ceph-mon[30956]: Deploying daemon osd.3 on smithi018 2024-09-19T08:38:45.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:44 smithi162 ceph-mon[34870]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:45.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:44 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:38:45.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:44 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:45.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:44 smithi162 ceph-mon[34870]: Deploying daemon osd.3 on smithi018 2024-09-19T08:38:45.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:44 smithi150 ceph-mon[34610]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:45.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:44 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:38:45.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:44 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:45.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:44 smithi150 ceph-mon[34610]: Deploying daemon osd.3 on smithi018 2024-09-19T08:38:46.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:46 smithi018 ceph-mon[30956]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T08:38:47.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:46 smithi162 ceph-mon[34870]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T08:38:47.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:46 smithi150 ceph-mon[34610]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T08:38:49.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:48 smithi018 ceph-mon[30956]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T08:38:49.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:48 smithi162 ceph-mon[34870]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T08:38:49.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:48 smithi150 ceph-mon[34610]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T08:38:51.128 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:50 smithi018 ceph-mon[30956]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:38:51.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:51.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:51.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:51.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:50 smithi162 ceph-mon[34870]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:38:51.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:51.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:51.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:50 smithi150 ceph-mon[34610]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:38:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:51.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:53.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:52 smithi162 ceph-mon[34870]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:53.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:52 smithi018 ceph-mon[30956]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:53.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:52 smithi150 ceph-mon[34610]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:54.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:54.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:54.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.309+0000 7fe487fff640 1 -- 172.21.15.18:0/3626881254 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe4a0062630 con 0x7fe4880a31e0 2024-09-19T08:38:54.309 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 3 on host 'smithi018' 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.311+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe4880a31e0 msgr2=0x7fe4880a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.311+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe4880a31e0 0x7fe4880a56a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0101b50 tx=0x7fe490005f90 comp rx=0 tx=0).stop 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.311+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 msgr2=0x7fe4a01a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.311+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a01a14b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe498031970 tx=0x7fe498003ba0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 shutdown_connections 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe4880a31e0 0x7fe4880a56a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a01026b0 0x7fe4a01a14b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4a0101cf0 0x7fe4a019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 --2- 172.21.15.18:0/3626881254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4a0100af0 0x7fe4a006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 >> 172.21.15.18:0/3626881254 conn(0x7fe4a00fc2a0 msgr2=0x7fe4a0105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 shutdown_connections 2024-09-19T08:38:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:38:54.312+0000 7fe4a52d8640 1 -- 172.21.15.18:0/3626881254 wait complete. 2024-09-19T08:38:54.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:54.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:54.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:54.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:54.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:54.952 DEBUG:teuthology.orchestra.run.smithi018:osd.3> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:38:54.955 INFO:tasks.cephadm:Deploying osd.4 on smithi150 with /dev/vg_nvme/lv_3... 2024-09-19T08:38:54.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:38:55.173 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:54 smithi018 ceph-mon[30956]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:55.173 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:55.173 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:55.173 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:38:55.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:54 smithi150 ceph-mon[34610]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:55.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:55.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:55.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:54 smithi162 ceph-mon[34870]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:56.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:55 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:38:56.194 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:38:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:38:55.943+0000 7fece61b3640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:38:56.243 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:55 smithi150 ceph-mon[34610]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:38:56.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:55 smithi162 ceph-mon[34870]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:38:57.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:56 smithi018 ceph-mon[30956]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:57.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:56 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:38:57.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:56 smithi018 ceph-mon[30956]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:38:57.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:56 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:38:57.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:57.272 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:56 smithi150 ceph-mon[34610]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:57.272 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:56 smithi150 ceph-mon[34610]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:38:57.272 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:56 smithi150 ceph-mon[34610]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:38:57.273 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:56 smithi150 ceph-mon[34610]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:38:57.273 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:56 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:57.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:56 smithi162 ceph-mon[34870]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:38:57.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:56 smithi162 ceph-mon[34870]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:38:57.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:56 smithi162 ceph-mon[34870]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:38:57.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:56 smithi162 ceph-mon[34870]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:38:57.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:56 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:57.627 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:38:57.497+0000 7fece2136640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:38:57.627 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:38:57.502+0000 7fecd9f56640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:38:57.639 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:38:57.665 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_3 2024-09-19T08:38:57.913 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:38:58.237 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:57 smithi150 ceph-mon[34610]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:38:58.238 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:57 smithi150 ceph-mon[34610]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:38:58.238 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:57 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:58.238 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:57 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:58.238 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:57 smithi150 ceph-mon[34610]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' 2024-09-19T08:38:58.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:57 smithi162 ceph-mon[34870]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:38:58.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:57 smithi162 ceph-mon[34870]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:38:58.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:57 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:58.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:57 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:58.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:57 smithi162 ceph-mon[34870]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' 2024-09-19T08:38:58.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 -- 172.21.15.150:0/3692958650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 msgr2=0x7f8734100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 --2- 172.21.15.150:0/3692958650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734100ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8730009900 tx=0x7f873002a410 comp rx=0 tx=0).stop 2024-09-19T08:38:58.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 -- 172.21.15.150:0/3692958650 shutdown_connections 2024-09-19T08:38:58.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 --2- 172.21.15.150:0/3692958650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102690 0x7f8734108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 --2- 172.21.15.150:0/3692958650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734101cd0 0x7f8734102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 --2- 172.21.15.150:0/3692958650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734100ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 -- 172.21.15.150:0/3692958650 >> 172.21.15.150:0/3692958650 conn(0x7f87340fc280 msgr2=0x7f87340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 -- 172.21.15.150:0/3692958650 shutdown_connections 2024-09-19T08:38:58.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.439+0000 7f873b6b1640 1 -- 172.21.15.150:0/3692958650 wait complete. 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 Processor -- start 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 -- start start 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734101cd0 0x7f87341981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734102690 0x7f873419f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f873410d6f0 con 0x7f8734101cd0 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f873410d570 con 0x7f8734100ad0 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873b6b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f873410d870 con 0x7f8734102690 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32940/0 (socket says 172.21.15.150:32940) 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 -- 172.21.15.150:0/589540955 learned_addr learned my addr 172.21.15.150:0/589540955 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f8738c4c640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734101cd0 0x7f87341981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 -- 172.21.15.150:0/589540955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734102690 msgr2=0x7f873419f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734102690 0x7f873419f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 -- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734101cd0 msgr2=0x7f87341981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734101cd0 0x7f87341981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.440+0000 7f873944d640 1 -- 172.21.15.150:0/589540955 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873419f8b0 con 0x7f8734100ad0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.441+0000 7f873944d640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734197c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8730009850 tx=0x7f87300318f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.441+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873003f030 con 0x7f8734100ad0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.441+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873419fb40 con 0x7f8734100ad0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.441+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8730003d30 con 0x7f8734100ad0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.441+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730035070 con 0x7f8734100ad0 2024-09-19T08:38:58.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.441+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87341a0020 con 0x7f8734100ad0 2024-09-19T08:38:58.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.442+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8734107e00 con 0x7f8734100ad0 2024-09-19T08:38:58.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:38:58.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-mon[30956]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:38:58.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:58.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:58.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:57 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499]' entity='osd.3' 2024-09-19T08:38:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.443+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8730042030 con 0x7f8734100ad0 2024-09-19T08:38:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.443+0000 7f872a7fc640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87200a3240 0x7f87200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.444+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f87300eeeb0 con 0x7f8734100ad0 2024-09-19T08:38:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.444+0000 7f8738c4c640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87200a3240 0x7f87200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.444+0000 7f8738c4c640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87200a3240 0x7f87200a5700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87341991a0 tx=0x7f872400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.448+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8730049030 con 0x7f8734100ad0 2024-09-19T08:38:58.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:38:58.622+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f87340630d0 con 0x7f87200a3240 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] boot 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi018 2024-09-19T08:38:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:59.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] boot 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi018 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.319 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:59.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: osd.3 [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] boot 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T08:38:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:59.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:00.223 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:59 smithi150 ceph-mon[34610]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:39:00.223 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:38:59 smithi150 ceph-mon[34610]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:39:00.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:59 smithi162 ceph-mon[34870]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:39:00.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:38:59 smithi162 ceph-mon[34870]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:39:00.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:59 smithi018 ceph-mon[30956]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:39:00.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:38:59 smithi018 ceph-mon[30956]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:39:01.232 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:00 smithi150 ceph-mon[34610]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:01.232 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:00 smithi150 ceph-mon[34610]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:39:01.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:00 smithi162 ceph-mon[34870]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:01.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:00 smithi162 ceph-mon[34870]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:39:01.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:00 smithi018 ceph-mon[30956]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:01.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:00 smithi018 ceph-mon[30956]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:39:02.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:01 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/3681045307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]: dispatch 2024-09-19T08:39:02.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:01 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]: dispatch 2024-09-19T08:39:02.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:01 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]': finished 2024-09-19T08:39:02.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:01 smithi150 ceph-mon[34610]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:39:02.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:01 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:01 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/2389383601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:02.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:01 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/3681045307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]: dispatch 2024-09-19T08:39:02.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:01 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]: dispatch 2024-09-19T08:39:02.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:01 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]': finished 2024-09-19T08:39:02.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:01 smithi162 ceph-mon[34870]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:39:02.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:01 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:01 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/2389383601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:02.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:01 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/3681045307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]: dispatch 2024-09-19T08:39:02.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:01 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]: dispatch 2024-09-19T08:39:02.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:01 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4942de51-8d38-4707-a4ba-d72fa75043d4"}]': finished 2024-09-19T08:39:02.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:01 smithi018 ceph-mon[30956]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:39:02.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:01 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/2389383601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:03.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:03 smithi150 ceph-mon[34610]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:03.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:03 smithi162 ceph-mon[34870]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:03.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:03 smithi018 ceph-mon[30956]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:05.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:05 smithi150 ceph-mon[34610]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:05 smithi162 ceph-mon[34870]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:05.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:05 smithi018 ceph-mon[30956]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:07 smithi150 ceph-mon[34610]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:39:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:07 smithi162 ceph-mon[34870]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:39:07.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:07 smithi018 ceph-mon[30956]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:39:09.210 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:09 smithi150 ceph-mon[34610]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T08:39:09.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:09 smithi162 ceph-mon[34870]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T08:39:09.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:09 smithi018 ceph-mon[30956]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T08:39:10.234 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:39:10.235 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:10.235 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:10 smithi150 ceph-mon[34610]: Deploying daemon osd.4 on smithi150 2024-09-19T08:39:10.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:39:10.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:10.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:10 smithi162 ceph-mon[34870]: Deploying daemon osd.4 on smithi150 2024-09-19T08:39:10.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:39:10.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:10.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:10 smithi018 ceph-mon[30956]: Deploying daemon osd.4 on smithi150 2024-09-19T08:39:11.245 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:11 smithi150 ceph-mon[34610]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:39:11.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:11 smithi162 ceph-mon[34870]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:39:11.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:11 smithi018 ceph-mon[30956]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:39:13.278 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:13 smithi150 ceph-mon[34610]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:39:13.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:13 smithi162 ceph-mon[34870]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:39:13.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:13 smithi018 ceph-mon[30956]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:39:15.191 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:15 smithi150 ceph-mon[34610]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:15.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:15 smithi162 ceph-mon[34870]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:15.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:15 smithi018 ceph-mon[30956]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:16.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:16.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:16.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:16.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:16.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:16.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:16.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:16.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:16.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:17.142 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:17 smithi150 ceph-mon[34610]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:17.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:17 smithi162 ceph-mon[34870]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:17 smithi018 ceph-mon[30956]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.245+0000 7f872a7fc640 1 -- 172.21.15.150:0/589540955 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f87340630d0 con 0x7f87200a3240 2024-09-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 4 on host 'smithi150' 2024-09-19T08:39:19.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87200a3240 msgr2=0x7f87200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:19.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87200a3240 0x7f87200a5700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87341991a0 tx=0x7f872400a4c0 comp rx=0 tx=0).stop 2024-09-19T08:39:19.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 msgr2=0x7f8734197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:19.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734197c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8730009850 tx=0x7f87300318f0 comp rx=0 tx=0).stop 2024-09-19T08:39:19.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 shutdown_connections 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87200a3240 0x7f87200a5700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734102690 0x7f873419f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734101cd0 0x7f87341981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 --2- 172.21.15.150:0/589540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8734100ad0 0x7f8734197c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 >> 172.21.15.150:0/589540955 conn(0x7f87340fc280 msgr2=0x7f8734104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 shutdown_connections 2024-09-19T08:39:19.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:39:19.247+0000 7f873b6b1640 1 -- 172.21.15.150:0/589540955 wait complete. 2024-09-19T08:39:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:19.934 DEBUG:teuthology.orchestra.run.smithi150:osd.4> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:39:19.938 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-19T08:39:19.938 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:39:20.195 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:39:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:21 smithi162 ceph-mon[34870]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:21.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:21 smithi018 ceph-mon[30956]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:21 smithi150 ceph-mon[34610]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:21.816 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:39:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:39:21.553+0000 7f0a245af640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:39:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:22 smithi162 ceph-mon[34870]: from='osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:22 smithi162 ceph-mon[34870]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:22.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:22 smithi018 ceph-mon[30956]: from='osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:22.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:22 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:22.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:22 smithi150 ceph-mon[34610]: from='osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:22.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:22 smithi150 ceph-mon[34610]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:22.829 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:39:22.853 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-19T08:39:23.109 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:39:23.554 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:23.555 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:39:23.555 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:39:23.555 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:39:23.555 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:23.555 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:39:23.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:23.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:23.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.557 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:23.557 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:23.557 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:23 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 -- 172.21.15.162:0/2641614680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 msgr2=0x7fb014103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:23.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 --2- 172.21.15.162:0/2641614680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014103280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faffc009900 tx=0x7faffc02a410 comp rx=0 tx=0).stop 2024-09-19T08:39:23.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 -- 172.21.15.162:0/2641614680 shutdown_connections 2024-09-19T08:39:23.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 --2- 172.21.15.162:0/2641614680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0141037c0 0x7fb01410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 --2- 172.21.15.162:0/2641614680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014103280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 --2- 172.21.15.162:0/2641614680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb014101c00 0x7fb014102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 -- 172.21.15.162:0/2641614680 >> 172.21.15.162:0/2641614680 conn(0x7fb0140fd390 msgr2=0x7fb0140ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 -- 172.21.15.162:0/2641614680 shutdown_connections 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.554+0000 7fb0192da640 1 -- 172.21.15.162:0/2641614680 wait complete. 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 Processor -- start 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 -- start start 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb014101c00 0x7fb014197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:23.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0141037c0 0x7fb01419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb01410d730 con 0x7fb014101c00 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb01410d5b0 con 0x7fb0141037c0 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0192da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb01410d8b0 con 0x7fb014102e00 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36118/0 (socket says 172.21.15.162:36118) 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 -- 172.21.15.162:0/1756759920 learned_addr learned my addr 172.21.15.162:0/1756759920 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb0137fe640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0141037c0 0x7fb01419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb012ffd640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb014101c00 0x7fb014197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 -- 172.21.15.162:0/1756759920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0141037c0 msgr2=0x7fb01419f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:23.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0141037c0 0x7fb01419f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 -- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb014101c00 msgr2=0x7fb014197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb014101c00 0x7fb014197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb00bfff640 1 -- 172.21.15.162:0/1756759920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01419fa10 con 0x7fb014102e00 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.555+0000 7fb012ffd640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb014101c00 0x7fb014197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.556+0000 7fb00bfff640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014198320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faffc004770 tx=0x7faffc0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.556+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc03f030 con 0x7fb014102e00 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.556+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01419fca0 con 0x7fb014102e00 2024-09-19T08:39:23.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.556+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faffc003cb0 con 0x7fb014102e00 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.556+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc035070 con 0x7fb014102e00 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.556+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0141a0180 con 0x7fb014102e00 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.557+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0141090a0 con 0x7fb014102e00 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.558+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faffc042030 con 0x7fb014102e00 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.558+0000 7fb010ff9640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0000a3270 0x7fb0000a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.559+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7faffc0eee10 con 0x7fb014102e00 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.559+0000 7fb012ffd640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0000a3270 0x7fb0000a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.559+0000 7fb012ffd640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0000a3270 0x7fb0000a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0040058c0 tx=0x7fb004005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:23.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.563+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faffc0f2030 con 0x7fb014102e00 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:23.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:23.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:23.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:23.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:23.740+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb014062630 con 0x7fb0000a3270 2024-09-19T08:39:23.815 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:39:23.447+0000 7f0a20532640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:39:23.815 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:39:23.453+0000 7f0a1c35a640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:23.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:23.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:23.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:23 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi150 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi150 to 8544M 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:24.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:24 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi150 2024-09-19T08:39:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi150 to 8544M 2024-09-19T08:39:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:39:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:39:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:24.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:24.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:24.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:24 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:24.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi150 2024-09-19T08:39:24.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi150 to 8544M 2024-09-19T08:39:24.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:39:24.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:39:24.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:24.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:24.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:24.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:24.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:39:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:39:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] boot 2024-09-19T08:39:25.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:39:25.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:39:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:39:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] boot 2024-09-19T08:39:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:39:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: osd.4 [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] boot 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:39:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:26.651 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:26 smithi162 ceph-mon[34870]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:39:26.651 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:26 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/2588345728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]: dispatch 2024-09-19T08:39:26.651 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:26 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]: dispatch 2024-09-19T08:39:26.651 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:26 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]': finished 2024-09-19T08:39:26.651 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:26 smithi162 ceph-mon[34870]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:39:26.651 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:26 smithi150 ceph-mon[34610]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:39:26.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:26 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/2588345728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]: dispatch 2024-09-19T08:39:26.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:26 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]: dispatch 2024-09-19T08:39:26.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:26 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]': finished 2024-09-19T08:39:26.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:26 smithi150 ceph-mon[34610]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:39:26.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:26 smithi018 ceph-mon[30956]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:39:26.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/2588345728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]: dispatch 2024-09-19T08:39:26.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:26 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]: dispatch 2024-09-19T08:39:26.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:26 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3148eeed-0f5a-4d80-8a3d-28d34ce6be50"}]': finished 2024-09-19T08:39:26.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:26 smithi018 ceph-mon[30956]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:39:26.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:27 smithi150 ceph-mon[34610]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:27 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/1653770041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:27 smithi162 ceph-mon[34870]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:27 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/1653770041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:27.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:27 smithi018 ceph-mon[30956]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:27.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1653770041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:29.719 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:29 smithi162 ceph-mon[34870]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:29.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:29 smithi150 ceph-mon[34610]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:29.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:29 smithi018 ceph-mon[30956]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:31.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:31 smithi162 ceph-mon[34870]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:31 smithi150 ceph-mon[34610]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:31 smithi018 ceph-mon[30956]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:33.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:33 smithi150 ceph-mon[34610]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:33.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:33 smithi162 ceph-mon[34870]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:33.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:33 smithi018 ceph-mon[30956]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:34.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:39:34.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:34.825 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:39:34.825 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:34.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:39:34.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:35.596 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:35 smithi162 ceph-mon[34870]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:35.596 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:35 smithi162 ceph-mon[34870]: Deploying daemon osd.5 on smithi162 2024-09-19T08:39:35.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:35 smithi150 ceph-mon[34610]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:35.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:35 smithi150 ceph-mon[34610]: Deploying daemon osd.5 on smithi162 2024-09-19T08:39:35.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:35 smithi018 ceph-mon[30956]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:35.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:35 smithi018 ceph-mon[30956]: Deploying daemon osd.5 on smithi162 2024-09-19T08:39:37.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:37 smithi162 ceph-mon[34870]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:37.746 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:37 smithi018 ceph-mon[30956]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:37.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:37 smithi150 ceph-mon[34610]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:39.643 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:39 smithi162 ceph-mon[34870]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:39.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:39 smithi150 ceph-mon[34610]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:39.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:39 smithi018 ceph-mon[30956]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:41.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:41 smithi162 ceph-mon[34870]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:41.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:41.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:41.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:41.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:41 smithi150 ceph-mon[34610]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:41.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:41.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:41.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:41.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:41 smithi018 ceph-mon[30956]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:41.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:41.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:41.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:43 smithi150 ceph-mon[34610]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:43.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:43.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:43.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:43 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:43 smithi162 ceph-mon[34870]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:43.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:43.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:43.850 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:43 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:43 smithi018 ceph-mon[30956]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:44.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.562+0000 7fb010ff9640 1 -- 172.21.15.162:0/1756759920 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb014062630 con 0x7fb0000a3270 2024-09-19T08:39:44.562 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0000a3270 msgr2=0x7fb0000a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0000a3270 0x7fb0000a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0040058c0 tx=0x7fb004005850 comp rx=0 tx=0).stop 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 msgr2=0x7fb014198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014198320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faffc004770 tx=0x7faffc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 shutdown_connections 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0000a3270 0x7fb0000a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0141037c0 0x7fb01419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014102e00 0x7fb014198320 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 --2- 172.21.15.162:0/1756759920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb014101c00 0x7fb014197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.564+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 >> 172.21.15.162:0/1756759920 conn(0x7fb0140fd390 msgr2=0x7fb014106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.565+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 shutdown_connections 2024-09-19T08:39:44.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:39:44.565+0000 7fb0192da640 1 -- 172.21.15.162:0/1756759920 wait complete. 2024-09-19T08:39:45.194 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:39:45.197 INFO:tasks.cephadm:Deploying osd.6 on smithi018 with /dev/vg_nvme/lv_2... 2024-09-19T08:39:45.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:39:45.461 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:39:45.685 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:45 smithi162 ceph-mon[34870]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:45.685 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:45.685 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:45.685 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:45.795 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:45 smithi018 ceph-mon[30956]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:45.795 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:45.795 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:45.795 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:45 smithi150 ceph-mon[34610]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:46.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:46 smithi018 ceph-mon[30956]: from='osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:46.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:46 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:46.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:46 smithi162 ceph-mon[34870]: from='osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:46.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:46 smithi162 ceph-mon[34870]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:46.667 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:39:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:39:46.371+0000 7fa961989640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:39:46.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:46 smithi150 ceph-mon[34610]: from='osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:46.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:46 smithi150 ceph-mon[34610]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:47.667 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:39:47.506+0000 7fa95d90c640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:39:47.667 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:39:47.511+0000 7fa959734640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:39:47.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-mon[34870]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:47.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-mon[34870]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:39:47.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-mon[34870]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:39:47.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:47.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-mon[34870]: from='osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:39:47.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:47 smithi162 ceph-mon[34870]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:39:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:47 smithi018 ceph-mon[30956]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:47 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:39:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:47 smithi018 ceph-mon[30956]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:39:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:47 smithi018 ceph-mon[30956]: from='osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:39:47.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:47 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:39:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:47 smithi150 ceph-mon[34610]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:47 smithi150 ceph-mon[34610]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:39:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:47 smithi150 ceph-mon[34610]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:39:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:47.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:47 smithi150 ceph-mon[34610]: from='osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:39:47.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:47 smithi150 ceph-mon[34610]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:39:48.076 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:39:48.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-09-19T08:39:48.362 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:48.761 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:48.761 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:39:48.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:48.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 -- 172.21.15.18:0/150750662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 msgr2=0x7f04c010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:48.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 --2- 172.21.15.18:0/150750662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c010a050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009ca0 tx=0x7f04b802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:48.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 -- 172.21.15.18:0/150750662 shutdown_connections 2024-09-19T08:39:48.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 --2- 172.21.15.18:0/150750662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c010a050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 --2- 172.21.15.18:0/150750662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 0x7f04c0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 --2- 172.21.15.18:0/150750662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04c0101c00 0x7f04c0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 -- 172.21.15.18:0/150750662 >> 172.21.15.18:0/150750662 conn(0x7f04c00fd390 msgr2=0x7f04c00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 -- 172.21.15.18:0/150750662 shutdown_connections 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.845+0000 7f04c55a3640 1 -- 172.21.15.18:0/150750662 wait complete. 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 Processor -- start 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 -- start start 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04c0101c00 0x7f04c0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 0x7f04c00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04c010d7b0 con 0x7f04c01037c0 2024-09-19T08:39:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f04c010d630 con 0x7f04c0102e00 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04c55a3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04c010d930 con 0x7f04c0101c00 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43618/0 (socket says 172.21.15.18:43618) 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.846+0000 7f04bf7fe640 1 -- 172.21.15.18:0/2143172835 learned_addr learned my addr 172.21.15.18:0/2143172835 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04beffd640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04c0101c00 0x7f04c0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04b7fff640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 0x7f04c00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bf7fe640 1 -- 172.21.15.18:0/2143172835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04c0101c00 msgr2=0x7f04c0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bf7fe640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04c0101c00 0x7f04c0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bf7fe640 1 -- 172.21.15.18:0/2143172835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 msgr2=0x7f04c00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bf7fe640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 0x7f04c00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bf7fe640 1 -- 172.21.15.18:0/2143172835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c00753e0 con 0x7f04c01037c0 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04b7fff640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 0x7f04c00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bf7fe640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c0074b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009dc0 tx=0x7f04b8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8004040 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04b8004690 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b802f4c0 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c01a1f70 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.847+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c01a2420 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.848+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c0109050 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.849+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f04b8030650 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.850+0000 7f04bcff9640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04ac0a3240 0x7f04ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.850+0000 7f04beffd640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04ac0a3240 0x7f04ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.850+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7f04b80f0540 con 0x7f04c01037c0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.850+0000 7f04beffd640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04ac0a3240 0x7f04ac0a5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f04c0102c60 tx=0x7f04b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:48.854+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04b80be060 con 0x7f04c01037c0 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:48.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:48.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:39:49.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:39:49.039+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f04c0062630 con 0x7f04ac0a3240 2024-09-19T08:39:49.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:39:49.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:39:49.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:49.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T08:39:49.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T08:39:49.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:49.798 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] boot 2024-09-19T08:39:49.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:39:49.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:49.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:49.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:49.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:49.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:39:49.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:39:49.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi162 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] boot 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:49.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:49 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:39:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:39:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi162 2024-09-19T08:39:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T08:39:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:49.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: osd.5 [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] boot 2024-09-19T08:39:49.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:39:49.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:49.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:49.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:49.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:49 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:50.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:50 smithi018 ceph-mon[30956]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:50.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:50 smithi018 ceph-mon[30956]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:39:50.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:50 smithi150 ceph-mon[34610]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:50.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:50 smithi150 ceph-mon[34610]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:39:50.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:50 smithi162 ceph-mon[34870]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:50.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:50 smithi162 ceph-mon[34870]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:39:51.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:51.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:39:51.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:39:51.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1093161700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4e2e48e-dfd9-4f77-8260-54a8e0385543"}]: dispatch 2024-09-19T08:39:51.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1093161700' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4e2e48e-dfd9-4f77-8260-54a8e0385543"}]': finished 2024-09-19T08:39:51.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:39:51.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:39:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:39:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1093161700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4e2e48e-dfd9-4f77-8260-54a8e0385543"}]: dispatch 2024-09-19T08:39:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1093161700' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4e2e48e-dfd9-4f77-8260-54a8e0385543"}]': finished 2024-09-19T08:39:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:39:51.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:51 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1093161700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4e2e48e-dfd9-4f77-8260-54a8e0385543"}]: dispatch 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1093161700' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4e2e48e-dfd9-4f77-8260-54a8e0385543"}]': finished 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:39:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:51 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:52.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:52 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1911133980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:52.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:52 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1911133980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:52.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:52 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1911133980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:53.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:53 smithi150 ceph-mon[34610]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:53.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:53 smithi162 ceph-mon[34870]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:53.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:53 smithi018 ceph-mon[30956]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:55.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:55 smithi150 ceph-mon[34610]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:55 smithi162 ceph-mon[34870]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:55.930 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:55 smithi018 ceph-mon[30956]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:57.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:57 smithi018 ceph-mon[30956]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:39:57.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:57 smithi150 ceph-mon[34610]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:39:57.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:57 smithi162 ceph-mon[34870]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:39:59.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:59 smithi018 ceph-mon[30956]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T08:39:59.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:39:59.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:39:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:59.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:59 smithi150 ceph-mon[34610]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T08:39:59.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:39:59.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:39:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:59 smithi162 ceph-mon[34870]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T08:39:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:39:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:39:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:00 smithi150 ceph-mon[34610]: Deploying daemon osd.6 on smithi018 2024-09-19T08:40:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:00 smithi150 ceph-mon[34610]: overall HEALTH_OK 2024-09-19T08:40:00.824 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:00 smithi018 ceph-mon[30956]: Deploying daemon osd.6 on smithi018 2024-09-19T08:40:00.825 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:00 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T08:40:00.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:00 smithi162 ceph-mon[34870]: Deploying daemon osd.6 on smithi018 2024-09-19T08:40:00.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:00 smithi162 ceph-mon[34870]: overall HEALTH_OK 2024-09-19T08:40:01.739 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:01 smithi018 ceph-mon[30956]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:40:01.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:01 smithi150 ceph-mon[34610]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:40:01.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:01 smithi162 ceph-mon[34870]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:40:03.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:03 smithi150 ceph-mon[34610]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:40:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:03 smithi162 ceph-mon[34870]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:40:03.931 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:03 smithi018 ceph-mon[30956]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:40:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:05 smithi150 ceph-mon[34610]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:05 smithi162 ceph-mon[34870]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:05.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:05 smithi018 ceph-mon[30956]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:05.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:05.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:05.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:07.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:07 smithi150 ceph-mon[34610]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:07.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:07 smithi162 ceph-mon[34870]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:07.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:07 smithi018 ceph-mon[30956]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:09.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.439+0000 7f04bcff9640 1 -- 172.21.15.18:0/2143172835 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f04c0062630 con 0x7f04ac0a3240 2024-09-19T08:40:09.439 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 6 on host 'smithi018' 2024-09-19T08:40:09.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.441+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04ac0a3240 msgr2=0x7f04ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:09.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.441+0000 7f04c55a3640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04ac0a3240 0x7f04ac0a5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f04c0102c60 tx=0x7f04b0008040 comp rx=0 tx=0).stop 2024-09-19T08:40:09.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 msgr2=0x7f04c0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:09.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c0074b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009dc0 tx=0x7f04b8003ba0 comp rx=0 tx=0).stop 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 shutdown_connections 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04ac0a3240 0x7f04ac0a5700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04c01037c0 0x7f04c0074b20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c0102e00 0x7f04c00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 --2- 172.21.15.18:0/2143172835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04c0101c00 0x7f04c0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 >> 172.21.15.18:0/2143172835 conn(0x7f04c00fd390 msgr2=0x7f04c0106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 shutdown_connections 2024-09-19T08:40:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:40:09.442+0000 7f04c55a3640 1 -- 172.21.15.18:0/2143172835 wait complete. 2024-09-19T08:40:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:09 smithi162 ceph-mon[34870]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:09 smithi018 ceph-mon[30956]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:09.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:09 smithi150 ceph-mon[34610]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:10.047 DEBUG:teuthology.orchestra.run.smithi018:osd.6> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:40:10.050 INFO:tasks.cephadm:Deploying osd.7 on smithi150 with /dev/vg_nvme/lv_2... 2024-09-19T08:40:10.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:40:10.304 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:40:10.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:10.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:10.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:10.666 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:10.666 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:10.666 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:10.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:10.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:10.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:11.493 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:11 smithi018 ceph-mon[30956]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:11.747 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:11 smithi150 ceph-mon[34610]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:11 smithi162 ceph-mon[34870]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:11.944 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:40:11 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:40:11.667+0000 7f12a86a9640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:40:12.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:12 smithi150 ceph-mon[34610]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:40:12.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:12 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:40:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:12 smithi162 ceph-mon[34870]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:40:13.082 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:40:13.108 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_2 2024-09-19T08:40:13.356 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.759 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.760 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.760 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:13.760 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:13.760 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 -- 172.21.15.150:0/3446492212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208101cf0 msgr2=0x7f8208102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 --2- 172.21.15.150:0/3446492212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208101cf0 0x7f8208102170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009900 tx=0x7f81fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 -- 172.21.15.150:0/3446492212 shutdown_connections 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 --2- 172.21.15.150:0/3446492212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82081026b0 0x7f8208108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 --2- 172.21.15.150:0/3446492212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208101cf0 0x7f8208102170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 --2- 172.21.15.150:0/3446492212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8208100af0 0x7f8208100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 -- 172.21.15.150:0/3446492212 >> 172.21.15.150:0/3446492212 conn(0x7f82080fc2a0 msgr2=0x7f82080fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:13.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 -- 172.21.15.150:0/3446492212 shutdown_connections 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 -- 172.21.15.150:0/3446492212 wait complete. 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 Processor -- start 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.843+0000 7f820e8e5640 1 -- start start 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820e8e5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 0x7f8208197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820e8e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8208101cf0 0x7f8208198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820e8e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82081026b0 0x7f820819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820e8e5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f820810d750 con 0x7f8208101cf0 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820e8e5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f820810d5d0 con 0x7f8208100af0 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820e8e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f820810d8d0 con 0x7f82081026b0 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 0x7f8208197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:13.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f82077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8208101cf0 0x7f8208198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 0x7f8208197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:52522/0 (socket says 172.21.15.150:52522) 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 -- 172.21.15.150:0/2199274083 learned_addr learned my addr 172.21.15.150:0/2199274083 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f820ce82640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82081026b0 0x7f820819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 -- 172.21.15.150:0/2199274083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82081026b0 msgr2=0x7f820819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82081026b0 0x7f820819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 -- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8208101cf0 msgr2=0x7f8208198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8208101cf0 0x7f8208198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f8207fff640 1 -- 172.21.15.150:0/2199274083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820819fa70 con 0x7f8208100af0 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.844+0000 7f82077fe640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8208101cf0 0x7f8208198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.845+0000 7f8207fff640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 0x7f8208197e40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81f800e9c0 tx=0x7f81f800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.845+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f800cd80 con 0x7f8208100af0 2024-09-19T08:40:13.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.845+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820819fd60 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.845+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81f80035f0 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.845+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8010690 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.845+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82081a01c0 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.846+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8208107fb0 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.847+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f81f80037a0 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.848+0000 7f82057fa640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f81f00a3270 0x7f81f00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.848+0000 7f82077fe640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f81f00a3270 0x7f81f00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.848+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f81f80cf090 con 0x7f8208100af0 2024-09-19T08:40:13.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.848+0000 7f82077fe640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f81f00a3270 0x7f81f00a5730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81fc006010 tx=0x7f81fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:13.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:13.852+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81f809cbe0 con 0x7f8208100af0 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:13.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:13.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:13.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:13.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:13.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:14.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:14.027+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8208062630 con 0x7f81f00a3270 2024-09-19T08:40:14.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:40:13.963+0000 7f12a462c640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:40:14.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:40:13 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:40:13.971+0000 7f129c44c640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:40:14.803 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi018 2024-09-19T08:40:14.803 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T08:40:14.803 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:14.804 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi018 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065]' entity='osd.6' 2024-09-19T08:40:14.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:14.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:15.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:40:15.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:40:15.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:15.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:15.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:15.729 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] boot 2024-09-19T08:40:15.729 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:40:15.729 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] boot 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:40:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: osd.6 [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] boot 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:40:15.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:40:16.716 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:16 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/2600949260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]: dispatch 2024-09-19T08:40:16.716 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:16 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]: dispatch 2024-09-19T08:40:16.716 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:16 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]': finished 2024-09-19T08:40:16.716 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:16 smithi150 ceph-mon[34610]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:40:16.717 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:16 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/2600949260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]: dispatch 2024-09-19T08:40:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:16 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]: dispatch 2024-09-19T08:40:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:16 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]': finished 2024-09-19T08:40:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:16 smithi162 ceph-mon[34870]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:40:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:16 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/2600949260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]: dispatch 2024-09-19T08:40:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:16 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]: dispatch 2024-09-19T08:40:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:16 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a954f75a-ad76-4749-893b-6e30cafcb75a"}]': finished 2024-09-19T08:40:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:16 smithi018 ceph-mon[30956]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:40:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:17 smithi150 ceph-mon[34610]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:17 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/3107249260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:17 smithi162 ceph-mon[34870]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:17 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/3107249260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:17 smithi018 ceph-mon[30956]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:17 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/3107249260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:19 smithi150 ceph-mon[34610]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:19 smithi162 ceph-mon[34870]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:19.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:19 smithi018 ceph-mon[30956]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:21.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:21 smithi150 ceph-mon[34610]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:21 smithi162 ceph-mon[34870]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:21.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:21 smithi018 ceph-mon[30956]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:23.780 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:23 smithi150 ceph-mon[34610]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:23 smithi162 ceph-mon[34870]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:23.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:23 smithi018 ceph-mon[30956]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:25.529 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:25 smithi150 ceph-mon[34610]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:25.529 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:40:25.529 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:25 smithi162 ceph-mon[34870]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:40:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:25.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:25 smithi018 ceph-mon[30956]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:25.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:40:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:26.742 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:26 smithi150 ceph-mon[34610]: Deploying daemon osd.7 on smithi150 2024-09-19T08:40:26.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:26 smithi162 ceph-mon[34870]: Deploying daemon osd.7 on smithi150 2024-09-19T08:40:26.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:26 smithi018 ceph-mon[30956]: Deploying daemon osd.7 on smithi150 2024-09-19T08:40:27.794 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:27 smithi150 ceph-mon[34610]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:27 smithi162 ceph-mon[34870]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:27.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:27 smithi018 ceph-mon[30956]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:29.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:29 smithi150 ceph-mon[34610]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:29.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:29 smithi162 ceph-mon[34870]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:29.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:29 smithi018 ceph-mon[30956]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:31.638 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:31 smithi150 ceph-mon[34610]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:31.638 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:31 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:31.638 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:31 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:31.638 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:31 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:31 smithi162 ceph-mon[34870]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:31 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:31 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:31 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:31 smithi018 ceph-mon[30956]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:33.524 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:33 smithi150 ceph-mon[34610]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:33 smithi162 ceph-mon[34870]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:33.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:33 smithi018 ceph-mon[30956]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:34.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.777+0000 7f82057fa640 1 -- 172.21.15.150:0/2199274083 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8208062630 con 0x7f81f00a3270 2024-09-19T08:40:34.778 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 7 on host 'smithi150' 2024-09-19T08:40:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f81f00a3270 msgr2=0x7f81f00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f81f00a3270 0x7f81f00a5730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81fc006010 tx=0x7f81fc000bc0 comp rx=0 tx=0).stop 2024-09-19T08:40:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 msgr2=0x7f8208197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 0x7f8208197e40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81f800e9c0 tx=0x7f81f800ee80 comp rx=0 tx=0).stop 2024-09-19T08:40:34.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 shutdown_connections 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f81f00a3270 0x7f81f00a5730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82081026b0 0x7f820819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8208101cf0 0x7f8208198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 --2- 172.21.15.150:0/2199274083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208100af0 0x7f8208197e40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 >> 172.21.15.150:0/2199274083 conn(0x7f82080fc2a0 msgr2=0x7f8208105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 shutdown_connections 2024-09-19T08:40:34.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:40:34.780+0000 7f820e8e5640 1 -- 172.21.15.150:0/2199274083 wait complete. 2024-09-19T08:40:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:35.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:35.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:34 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:35.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:34 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:35.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:35.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.467 DEBUG:teuthology.orchestra.run.smithi150:osd.7> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:40:35.469 INFO:tasks.cephadm:Deploying osd.8 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-19T08:40:35.469 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:40:35.725 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:40:35.847 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:35 smithi162 ceph-mon[34870]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:35.847 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:35.847 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.847 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.978 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:35 smithi150 ceph-mon[34610]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:35.978 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:35.978 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:35.978 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:36.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:35 smithi018 ceph-mon[30956]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:36.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:36.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:36.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:36.805 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:36 smithi150 ceph-mon[34610]: from='osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:36.805 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:36 smithi150 ceph-mon[34610]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:36.805 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:40:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:40:36.502+0000 7f10d0069640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:40:37.006 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:36 smithi162 ceph-mon[34870]: from='osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:37.006 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:36 smithi162 ceph-mon[34870]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:37.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:36 smithi018 ceph-mon[30956]: from='osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:37.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:36 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:37 smithi162 ceph-mon[34870]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:37 smithi162 ceph-mon[34870]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:40:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:37 smithi162 ceph-mon[34870]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:40:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:37 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:37 smithi162 ceph-mon[34870]: from='osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:40:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:37 smithi162 ceph-mon[34870]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:40:38.031 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:37 smithi150 ceph-mon[34610]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:38.031 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:37 smithi150 ceph-mon[34610]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:40:38.031 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:37 smithi150 ceph-mon[34610]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:40:38.031 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:37 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:38.031 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:37 smithi150 ceph-mon[34610]: from='osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:40:38.031 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:37 smithi150 ceph-mon[34610]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:40:38.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:37 smithi018 ceph-mon[30956]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:37 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:40:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:37 smithi018 ceph-mon[30956]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:40:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:37 smithi018 ceph-mon[30956]: from='osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:40:38.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:37 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:40:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:40:38.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-19T08:40:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:40:38.731 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:40:38.434+0000 7f10cbfec640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:40:38.731 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:40:38.446+0000 7f10c3e0c640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:40:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:40:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:40:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:38 smithi150 ceph-mon[34610]: from='osd.7 ' entity='osd.7' 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:39.067 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:39.068 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.068 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:38 smithi162 ceph-mon[34870]: from='osd.7 ' entity='osd.7' 2024-09-19T08:40:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1252348645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc102690 msgr2=0x7f7dcc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1252348645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc102690 0x7f7dcc108f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009ca0 tx=0x7f7dc402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1252348645 shutdown_connections 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1252348645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc102690 0x7f7dcc108f20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1252348645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc101cd0 0x7f7dcc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1252348645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.153+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1252348645 >> 172.21.15.162:0/1252348645 conn(0x7f7dcc0fc280 msgr2=0x7f7dcc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.154+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1252348645 shutdown_connections 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.154+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1252348645 wait complete. 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.154+0000 7f7dd2eb7640 1 Processor -- start 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.154+0000 7f7dd2eb7640 1 -- start start 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc101cd0 0x7f7dcc1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc102690 0x7f7dcc19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10c5e0 con 0x7f7dcc102690 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10c460 con 0x7f7dcc101cd0 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10c760 con 0x7f7dcc100ad0 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44756/0 (socket says 172.21.15.162:44756) 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 -- 172.21.15.162:0/1920983493 learned_addr learned my addr 172.21.15.162:0/1920983493 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dcbfff640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc101cd0 0x7f7dcc1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 -- 172.21.15.162:0/1920983493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc101cd0 msgr2=0x7f7dcc1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc101cd0 0x7f7dcc1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 -- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc102690 msgr2=0x7f7dcc19f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc102690 0x7f7dcc19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 -- 172.21.15.162:0/1920983493 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc19f9e0 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd0c53640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc197db0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000d770 tx=0x7f7dc000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0017070 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7dc0009c30 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc19fcd0 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.155+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0003d00 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.156+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1a01b0 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.157+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc1a03e0 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.158+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7dc0003ea0 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.159+0000 7f7dc9ffb640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7dbc0a32f0 0x7f7dbc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.159+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5430+0+0 (secure 0 0 0) 0x7f7dc00ce770 con 0x7f7dcc100ad0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.159+0000 7f7dcbfff640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7dbc0a32f0 0x7f7dbc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.159+0000 7f7dcbfff640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7dbc0a32f0 0x7f7dbc0a57b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc1992d0 tx=0x7f7db800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.163+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7dc009bfd0 con 0x7f7dcc100ad0 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:38 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' 2024-09-19T08:40:39.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:40:39.341+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7dcc06a6b0 con 0x7f7dbc0a32f0 2024-09-19T08:40:40.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:40:40.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:40:40.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:40.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi150 2024-09-19T08:40:40.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi150 to 5696M 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] boot 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:40.054 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:39 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:40:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:40:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi150 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi150 to 5696M 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] boot 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:40.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:39 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi150 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi150 to 5696M 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: osd.7 [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] boot 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:40.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:40.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:40.807 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:40 smithi162 ceph-mon[34870]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:40.807 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:40 smithi162 ceph-mon[34870]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:40:41.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:40 smithi150 ceph-mon[34610]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:41.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:40 smithi150 ceph-mon[34610]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:40:41.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:40 smithi018 ceph-mon[30956]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:41.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:40 smithi018 ceph-mon[30956]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:40:42.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:41 smithi162 ceph-mon[34870]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:42.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:41 smithi162 ceph-mon[34870]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:40:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:41 smithi150 ceph-mon[34610]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:41 smithi150 ceph-mon[34610]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:40:42.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:41 smithi018 ceph-mon[30956]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:42.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:41 smithi018 ceph-mon[30956]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:40:43.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:40:43.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/3387435624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]: dispatch 2024-09-19T08:40:43.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]: dispatch 2024-09-19T08:40:43.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]': finished 2024-09-19T08:40:43.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:40:43.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:43.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:43.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/1360495784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/3387435624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]: dispatch 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]: dispatch 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]': finished 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/1360495784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:43.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/3387435624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]: dispatch 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]: dispatch 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "274f4216-c240-4033-993b-3ff22db0fcb8"}]': finished 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:43.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1360495784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:45.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:44 smithi162 ceph-mon[34870]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:45.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:44 smithi018 ceph-mon[30956]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:45.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:44 smithi150 ceph-mon[34610]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:46.989 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:46 smithi162 ceph-mon[34870]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:47.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:46 smithi018 ceph-mon[30956]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:47.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:46 smithi150 ceph-mon[34610]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:49.092 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:48 smithi162 ceph-mon[34870]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:49.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:48 smithi018 ceph-mon[30956]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:49.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:48 smithi150 ceph-mon[34610]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:51.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:50 smithi162 ceph-mon[34870]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:51.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:40:51.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:51.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:50 smithi162 ceph-mon[34870]: Deploying daemon osd.8 on smithi162 2024-09-19T08:40:51.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:50 smithi018 ceph-mon[30956]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:51.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:40:51.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:51.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:50 smithi018 ceph-mon[30956]: Deploying daemon osd.8 on smithi162 2024-09-19T08:40:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:50 smithi150 ceph-mon[34610]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:40:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:50 smithi150 ceph-mon[34610]: Deploying daemon osd.8 on smithi162 2024-09-19T08:40:53.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:52 smithi162 ceph-mon[34870]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:53.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:52 smithi018 ceph-mon[30956]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:53.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:52 smithi150 ceph-mon[34610]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:55.102 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:54 smithi162 ceph-mon[34870]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:55.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:54 smithi018 ceph-mon[30956]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:55.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:54 smithi150 ceph-mon[34610]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:57.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:56 smithi162 ceph-mon[34870]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:57.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:56 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:57.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:56 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:57.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:56 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:57.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:56 smithi018 ceph-mon[30956]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:57.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:57.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:57.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:57.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:56 smithi150 ceph-mon[34610]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:57.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:56 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:57.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:56 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:57.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:56 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:40:59.137 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:40:58 smithi150 ceph-mon[34610]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:59.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:40:58 smithi162 ceph-mon[34870]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:59.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:40:58 smithi018 ceph-mon[30956]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:00.124 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 8 on host 'smithi162' 2024-09-19T08:41:00.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.123+0000 7f7dc9ffb640 1 -- 172.21.15.162:0/1920983493 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7dcc06a6b0 con 0x7f7dbc0a32f0 2024-09-19T08:41:00.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7dbc0a32f0 msgr2=0x7f7dbc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7dbc0a32f0 0x7f7dbc0a57b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc1992d0 tx=0x7f7db800b590 comp rx=0 tx=0).stop 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 msgr2=0x7f7dcc197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc197db0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000d770 tx=0x7f7dc000dc30 comp rx=0 tx=0).stop 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 shutdown_connections 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7dbc0a32f0 0x7f7dbc0a57b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc102690 0x7f7dcc19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc101cd0 0x7f7dcc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 --2- 172.21.15.162:0/1920983493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dcc100ad0 0x7f7dcc197db0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.126+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 >> 172.21.15.162:0/1920983493 conn(0x7f7dcc0fc280 msgr2=0x7f7dcc069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.127+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 shutdown_connections 2024-09-19T08:41:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:00.127+0000 7f7dd2eb7640 1 -- 172.21.15.162:0/1920983493 wait complete. 2024-09-19T08:41:00.761 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.761 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.761 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:00.761 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:00.761 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.762 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:00.762 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.762 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.788 DEBUG:teuthology.orchestra.run.smithi162:osd.8> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:41:00.790 INFO:tasks.cephadm:Deploying osd.9 on smithi018 with /dev/vg_nvme/lv_1... 2024-09-19T08:41:00.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:41:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:00.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:00.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:01.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:01 smithi018 ceph-mon[30956]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:01.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:01 smithi150 ceph-mon[34610]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:01 smithi162 ceph-mon[34870]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:02.917 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:41:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:41:02.532+0000 7f6390795640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:41:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:03 smithi162 ceph-mon[34870]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:03 smithi162 ceph-mon[34870]: from='osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:41:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:03 smithi162 ceph-mon[34870]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:41:03.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:03 smithi018 ceph-mon[30956]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:03.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:03 smithi018 ceph-mon[30956]: from='osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:41:03.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:03 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:41:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:41:03.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-09-19T08:41:03.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:03 smithi150 ceph-mon[34610]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:03.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:03 smithi150 ceph-mon[34610]: from='osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:41:03.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:03 smithi150 ceph-mon[34610]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:41:04.089 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 -- 172.21.15.18:0/477468038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958102690 msgr2=0x7f9958108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 --2- 172.21.15.18:0/477468038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958102690 0x7f9958108f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9950009ca0 tx=0x7f995002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 -- 172.21.15.18:0/477468038 shutdown_connections 2024-09-19T08:41:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 --2- 172.21.15.18:0/477468038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958102690 0x7f9958108f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 --2- 172.21.15.18:0/477468038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958101cd0 0x7f9958102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 --2- 172.21.15.18:0/477468038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9958100ad0 0x7f9958100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 -- 172.21.15.18:0/477468038 >> 172.21.15.18:0/477468038 conn(0x7f99580fc280 msgr2=0x7f99580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 -- 172.21.15.18:0/477468038 shutdown_connections 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 -- 172.21.15.18:0/477468038 wait complete. 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.581+0000 7f995fda3640 1 Processor -- start 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 -- start start 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 0x7f9958197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9958101cd0 0x7f9958198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958102690 0x7f995819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f995810c5e0 con 0x7f9958100ad0 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f995810c460 con 0x7f9958101cd0 2024-09-19T08:41:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995fda3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f995810c760 con 0x7f9958102690 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 0x7f9958197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 0x7f9958197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54552/0 (socket says 172.21.15.18:54552) 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 -- 172.21.15.18:0/2008359033 learned_addr learned my addr 172.21.15.18:0/2008359033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995e340640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958102690 0x7f995819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995d33e640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9958101cd0 0x7f9958198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 -- 172.21.15.18:0/2008359033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958102690 msgr2=0x7f995819f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958102690 0x7f995819f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 -- 172.21.15.18:0/2008359033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9958101cd0 msgr2=0x7f9958198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9958101cd0 0x7f9958198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 -- 172.21.15.18:0/2008359033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995819f960 con 0x7f9958100ad0 2024-09-19T08:41:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f995db3f640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 0x7f9958197d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f995400c970 tx=0x7f995400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954007c10 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.582+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9954007db0 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.583+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995819fc50 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.583+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995400f870 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.583+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99581a0190 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.584+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99581a03c0 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.585+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f995400fa10 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.586+0000 7f994effd640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f99440a32c0 0x7f99440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.586+0000 7f995d33e640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f99440a32c0 0x7f99440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.586+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7f99540cf160 con 0x7f9958100ad0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.586+0000 7f995d33e640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f99440a32c0 0x7f99440a5780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9948005fd0 tx=0x7f9948005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.590+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f995409c9e0 con 0x7f9958100ad0 2024-09-19T08:41:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:04.776+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f99581a0590 con 0x7f99440a32c0 2024-09-19T08:41:04.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:41:04.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:41:04.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:04.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:41:04.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi162 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:04.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:04.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:04 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:41:04.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi162 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T08:41:04.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:04.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:04.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:04.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:04 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:05.667 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:41:05.267+0000 7f638c718640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:41:05.667 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:41:05.277+0000 7f6384538640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:05.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:05.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:05 smithi162 ceph-mon[34870]: from='osd.8 ' entity='osd.8' 2024-09-19T08:41:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:05.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:05 smithi150 ceph-mon[34610]: from='osd.8 ' entity='osd.8' 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:05.911 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:05.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:05.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:05 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' 2024-09-19T08:41:06.565 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:41:06.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:41:06.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:06.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] boot 2024-09-19T08:41:06.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:41:06.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:06.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:06 smithi018 ceph-mon[30956]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:41:06.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:41:06.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:41:06.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:06.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] boot 2024-09-19T08:41:06.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:41:06.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:06.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:06 smithi150 ceph-mon[34610]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: osd.8 [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] boot 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:41:06.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:06 smithi162 ceph-mon[34870]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:41:07.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:07 smithi150 ceph-mon[34610]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:07.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:07 smithi150 ceph-mon[34610]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:41:07.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:07 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2016078657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d898bb9-3d1f-4650-8419-c381984ff968"}]: dispatch 2024-09-19T08:41:07.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:07 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2016078657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d898bb9-3d1f-4650-8419-c381984ff968"}]': finished 2024-09-19T08:41:07.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:07 smithi150 ceph-mon[34610]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T08:41:07.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:07 smithi162 ceph-mon[34870]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:07 smithi162 ceph-mon[34870]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:41:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:07 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2016078657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d898bb9-3d1f-4650-8419-c381984ff968"}]: dispatch 2024-09-19T08:41:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:07 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2016078657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d898bb9-3d1f-4650-8419-c381984ff968"}]': finished 2024-09-19T08:41:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:07 smithi162 ceph-mon[34870]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T08:41:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:07 smithi018 ceph-mon[30956]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:41:07.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:07 smithi018 ceph-mon[30956]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:41:07.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:07 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2016078657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d898bb9-3d1f-4650-8419-c381984ff968"}]: dispatch 2024-09-19T08:41:07.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:07 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2016078657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d898bb9-3d1f-4650-8419-c381984ff968"}]': finished 2024-09-19T08:41:07.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:07 smithi018 ceph-mon[30956]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T08:41:07.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:08.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:08 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3400025805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:08.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:08 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3400025805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:08.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:08 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3400025805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:09 smithi150 ceph-mon[34610]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:09 smithi150 ceph-mon[34610]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:41:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:09.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:09 smithi162 ceph-mon[34870]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:09 smithi162 ceph-mon[34870]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:41:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:09.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:09 smithi018 ceph-mon[30956]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:09.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:09 smithi018 ceph-mon[30956]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:41:09.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:10.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:10 smithi150 ceph-mon[34610]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:41:10.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:10 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:10.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:10 smithi162 ceph-mon[34870]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:41:10.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:10 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:10.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:10 smithi018 ceph-mon[30956]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:41:10.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:11.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:11 smithi150 ceph-mon[34610]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T08:41:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:11 smithi162 ceph-mon[34870]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T08:41:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:11 smithi018 ceph-mon[30956]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T08:41:13.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:13 smithi018 ceph-mon[30956]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T08:41:13.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:13 smithi150 ceph-mon[34610]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T08:41:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:13 smithi162 ceph-mon[34870]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T08:41:15.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:15 smithi150 ceph-mon[34610]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T08:41:15.913 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:15 smithi018 ceph-mon[30956]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T08:41:15.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:15 smithi162 ceph-mon[34870]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T08:41:16.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:41:16.784 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:41:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:41:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:17.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:17 smithi018 ceph-mon[30956]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:41:17.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:17 smithi018 ceph-mon[30956]: Deploying daemon osd.9 on smithi018 2024-09-19T08:41:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:17 smithi150 ceph-mon[34610]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:41:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:17 smithi150 ceph-mon[34610]: Deploying daemon osd.9 on smithi018 2024-09-19T08:41:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:17 smithi162 ceph-mon[34870]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:41:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:17 smithi162 ceph-mon[34870]: Deploying daemon osd.9 on smithi018 2024-09-19T08:41:19.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:19 smithi018 ceph-mon[30956]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:41:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:19 smithi150 ceph-mon[34610]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:41:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:19 smithi162 ceph-mon[34870]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T08:41:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:21 smithi150 ceph-mon[34610]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:41:21.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:21 smithi018 ceph-mon[30956]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:41:21.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:21 smithi162 ceph-mon[34870]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:41:22.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:22.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:22.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:22.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:22.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:22.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:22.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:22.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:22.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:23.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:23 smithi018 ceph-mon[30956]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:23 smithi150 ceph-mon[34610]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:23.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:23 smithi162 ceph-mon[34870]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:25 smithi150 ceph-mon[34610]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:25 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:25 smithi162 ceph-mon[34870]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:25 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:25 smithi018 ceph-mon[30956]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:25.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:26.148 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 9 on host 'smithi018' 2024-09-19T08:41:26.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.148+0000 7f994effd640 1 -- 172.21.15.18:0/2008359033 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f99581a0590 con 0x7f99440a32c0 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f99440a32c0 msgr2=0x7f99440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f99440a32c0 0x7f99440a5780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9948005fd0 tx=0x7f9948005850 comp rx=0 tx=0).stop 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 msgr2=0x7f9958197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 0x7f9958197d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f995400c970 tx=0x7f995400ce30 comp rx=0 tx=0).stop 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 shutdown_connections 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f99440a32c0 0x7f99440a5780 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:26.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958102690 0x7f995819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:26.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9958101cd0 0x7f9958198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:26.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 --2- 172.21.15.18:0/2008359033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9958100ad0 0x7f9958197d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:26.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 >> 172.21.15.18:0/2008359033 conn(0x7f99580fc280 msgr2=0x7f99580fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:26.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.151+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 shutdown_connections 2024-09-19T08:41:26.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:41:26.152+0000 7f995fda3640 1 -- 172.21.15.18:0/2008359033 wait complete. 2024-09-19T08:41:26.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:26.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:26.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:26.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:26.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:26.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:26 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:26.831 DEBUG:teuthology.orchestra.run.smithi018:osd.9> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T08:41:26.834 INFO:tasks.cephadm:Deploying osd.10 on smithi150 with /dev/vg_nvme/lv_1... 2024-09-19T08:41:26.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:41:26.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:26.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:26.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:26 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:41:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:27 smithi150 ceph-mon[34610]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:27.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:27 smithi018 ceph-mon[30956]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:27 smithi162 ceph-mon[34870]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:28.137 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:41:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:41:27.850+0000 7f357afe5640 -1 osd.9 0 log_to_monitors true 2024-09-19T08:41:28.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:28 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:41:28.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:28 smithi150 ceph-mon[34610]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:41:28.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:28 smithi162 ceph-mon[34870]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:41:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-19T08:41:29.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_1 2024-09-19T08:41:29.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:29 smithi150 ceph-mon[34610]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:29.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:29 smithi150 ceph-mon[34610]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:41:29.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:29 smithi150 ceph-mon[34610]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:41:29.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:29 smithi150 ceph-mon[34610]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:41:29.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:29.818 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:29 smithi162 ceph-mon[34870]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:29.818 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:29 smithi162 ceph-mon[34870]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:41:29.818 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:29 smithi162 ceph-mon[34870]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:41:29.818 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:29 smithi162 ceph-mon[34870]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:41:29.818 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:29.823 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:41:29.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:29 smithi018 ceph-mon[30956]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:29.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:29 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:41:29.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:29 smithi018 ceph-mon[30956]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:41:29.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:29 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T08:41:29.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3955360105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54100480 msgr2=0x7f6c54102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:30.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3955360105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54100480 0x7f6c54102890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009900 tx=0x7f6c5002a410 comp rx=0 tx=0).stop 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3955360105 shutdown_connections 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3955360105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c54105780 0x7f6c54105c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3955360105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c54102dd0 0x7f6c54105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3955360105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54100480 0x7f6c54102890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.317+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3955360105 >> 172.21.15.150:0/3955360105 conn(0x7f6c540fc270 msgr2=0x7f6c540fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3955360105 shutdown_connections 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3955360105 wait complete. 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 Processor -- start 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 -- start start 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c54100480 0x7f6c5419e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c54102dd0 0x7f6c5419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:30.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 0x7f6c541a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c54113d40 con 0x7f6c54100480 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6c54113bc0 con 0x7f6c54105780 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5bec7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c54113ec0 con 0x7f6c54102dd0 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5a464640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 0x7f6c541a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.318+0000 7f6c5a464640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 0x7f6c541a59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45620/0 (socket says 172.21.15.150:45620) 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 -- 172.21.15.150:0/3250182514 learned_addr learned my addr 172.21.15.150:0/3250182514 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c59462640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c54102dd0 0x7f6c5419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c59c63640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c54100480 0x7f6c5419e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 -- 172.21.15.150:0/3250182514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c54102dd0 msgr2=0x7f6c5419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c54102dd0 0x7f6c5419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:30.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 -- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c54100480 msgr2=0x7f6c5419e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c54100480 0x7f6c5419e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 -- 172.21.15.150:0/3250182514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c541a6040 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5a464640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 0x7f6c541a59d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00cce0 tx=0x7f6c4c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00f450 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c541a6330 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c4c00faa0 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c018b70 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.319+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c541a6820 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.320+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c540fdd60 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.321+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6c4c018d10 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.322+0000 7f6c4affd640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6c400a3270 0x7f6c400a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.322+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f6c4c0cf3a0 con 0x7f6c54105780 2024-09-19T08:41:30.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.322+0000 7f6c59c63640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6c400a3270 0x7f6c400a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:30.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.323+0000 7f6c59c63640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6c400a3270 0x7f6c400a5730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c500314e0 tx=0x7f6c500095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:30.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.326+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c4c014030 con 0x7f6c54105780 2024-09-19T08:41:30.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:41:30.092+0000 7f3576f68640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T08:41:30.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:41:30.104+0000 7f356ed88640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:41:30.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:30.503+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6c54062630 con 0x7f6c400a3270 2024-09-19T08:41:30.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:41:30.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:41:30.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' 2024-09-19T08:41:30.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:30.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:30.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:30 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:30.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:30 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T08:41:30.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:41:30.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:30.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965]' entity='osd.9' 2024-09-19T08:41:30.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:30.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:30.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:31.892 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:41:31.892 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:41:31.892 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi018 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] boot 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:41:31.893 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:31 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi018 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] boot 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:41:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:31 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: osd.9 [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] boot 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:41:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:33.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:33.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:41:33.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/3289386702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]: dispatch 2024-09-19T08:41:33.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]: dispatch 2024-09-19T08:41:33.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]': finished 2024-09-19T08:41:33.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:41:33.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:33.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:33 smithi150 ceph-mon[34610]: from='client.? 172.21.15.150:0/1462718680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/3289386702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]: dispatch 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]: dispatch 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]': finished 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:33 smithi162 ceph-mon[34870]: from='client.? 172.21.15.150:0/1462718680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/3289386702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]: dispatch 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]: dispatch 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06c9dfa6-9639-4595-9bb6-3662c207ac22"}]': finished 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:33.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:33 smithi018 ceph-mon[30956]: from='client.? 172.21.15.150:0/1462718680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:35 smithi162 ceph-mon[34870]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:35.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:35 smithi018 ceph-mon[30956]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:35 smithi150 ceph-mon[34610]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:37.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:37 smithi150 ceph-mon[34610]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:37 smithi162 ceph-mon[34870]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:37.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:37 smithi018 ceph-mon[30956]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:39 smithi162 ceph-mon[34870]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:39.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:39 smithi018 ceph-mon[30956]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:40.011 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:39 smithi150 ceph-mon[34610]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:41.870 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:41 smithi150 ceph-mon[34610]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:41.870 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:41:41.870 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:41.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:41 smithi162 ceph-mon[34870]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:41.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:41:41.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:41.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:41 smithi018 ceph-mon[30956]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:41.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:41:41.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:42.802 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:42 smithi150 ceph-mon[34610]: Deploying daemon osd.10 on smithi150 2024-09-19T08:41:42.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:42 smithi162 ceph-mon[34870]: Deploying daemon osd.10 on smithi150 2024-09-19T08:41:42.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:42 smithi018 ceph-mon[30956]: Deploying daemon osd.10 on smithi150 2024-09-19T08:41:43.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:43 smithi150 ceph-mon[34610]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:43.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:43 smithi162 ceph-mon[34870]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:43.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:43 smithi018 ceph-mon[30956]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:45.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:45 smithi162 ceph-mon[34870]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:45.917 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:45 smithi150 ceph-mon[34610]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:45.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:45 smithi018 ceph-mon[30956]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:47 smithi150 ceph-mon[34610]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:47.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:47.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:47 smithi162 ceph-mon[34870]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:47.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:47 smithi018 ceph-mon[30956]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:47.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:47.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:47.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:49.798 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:49 smithi150 ceph-mon[34610]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:49.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:49 smithi162 ceph-mon[34870]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:49.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:49 smithi018 ceph-mon[30956]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:50.582 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 10 on host 'smithi150' 2024-09-19T08:41:50.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.582+0000 7f6c4affd640 1 -- 172.21.15.150:0/3250182514 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6c54062630 con 0x7f6c400a3270 2024-09-19T08:41:50.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6c400a3270 msgr2=0x7f6c400a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6c400a3270 0x7f6c400a5730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c500314e0 tx=0x7f6c500095f0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 msgr2=0x7f6c541a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 0x7f6c541a59d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00cce0 tx=0x7f6c4c00a620 comp rx=0 tx=0).stop 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 shutdown_connections 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6c400a3270 0x7f6c400a5730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c54105780 0x7f6c541a59d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c54102dd0 0x7f6c5419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 --2- 172.21.15.150:0/3250182514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c54100480 0x7f6c5419e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.584+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 >> 172.21.15.150:0/3250182514 conn(0x7f6c540fc270 msgr2=0x7f6c541037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.585+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 shutdown_connections 2024-09-19T08:41:50.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-19T08:41:50.585+0000 7f6c5bec7640 1 -- 172.21.15.150:0/3250182514 wait complete. 2024-09-19T08:41:51.209 DEBUG:teuthology.orchestra.run.smithi150:osd.10> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T08:41:51.211 INFO:tasks.cephadm:Deploying osd.11 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-19T08:41:51.212 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:41:51.469 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:41:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:51 smithi150 ceph-mon[34610]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:51 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:51 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:51 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:51 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.855 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:51 smithi162 ceph-mon[34870]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:51.855 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:51 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.855 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:51 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.855 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:51 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.855 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:51 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:51 smithi018 ceph-mon[30956]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:51.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:51.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:53.680 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:53 smithi150 ceph-mon[34610]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:53.680 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:53 smithi150 ceph-mon[34610]: from='osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:53.680 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:53 smithi150 ceph-mon[34610]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:53.681 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:41:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:41:53.428+0000 7f1477bbe640 -1 osd.10 0 log_to_monitors true 2024-09-19T08:41:53.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:53 smithi162 ceph-mon[34870]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:53.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:53 smithi162 ceph-mon[34870]: from='osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:53.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:53 smithi162 ceph-mon[34870]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:53.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:53 smithi018 ceph-mon[30956]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:53.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:53 smithi018 ceph-mon[30956]: from='osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:53.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:53 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:54.246 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T08:41:54.272 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-19T08:41:54.521 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:41:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:41:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:41:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:41:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:54.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:54.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:54.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:54 smithi162 ceph-mon[34870]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:41:54.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:41:54.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:41:54.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:54.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:54.946 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:54 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:41:55.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 -- 172.21.15.162:0/1568326109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c104fd0 msgr2=0x7f5d3c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 --2- 172.21.15.162:0/1568326109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c104fd0 0x7f5d3c1073c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009900 tx=0x7f5d2c02a410 comp rx=0 tx=0).stop 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 -- 172.21.15.162:0/1568326109 shutdown_connections 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 --2- 172.21.15.162:0/1568326109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d3c107900 0x7f5d3c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 --2- 172.21.15.162:0/1568326109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c104fd0 0x7f5d3c1073c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 --2- 172.21.15.162:0/1568326109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 -- 172.21.15.162:0/1568326109 >> 172.21.15.162:0/1568326109 conn(0x7f5d3c0fc2a0 msgr2=0x7f5d3c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 -- 172.21.15.162:0/1568326109 shutdown_connections 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.021+0000 7f5d41da9640 1 -- 172.21.15.162:0/1568326109 wait complete. 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 Processor -- start 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 -- start start 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:55.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d3c104fd0 0x7f5d3c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d3c107900 0x7f5d3c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c10d730 con 0x7f5d3c107900 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c10d5b0 con 0x7f5d3c104fd0 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d41da9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c10d8b0 con 0x7f5d3c1026a0 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.022+0000 7f5d3b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44794/0 (socket says 172.21.15.162:44794) 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 -- 172.21.15.162:0/830254029 learned_addr learned my addr 172.21.15.162:0/830254029 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3affd640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d3c104fd0 0x7f5d3c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 -- 172.21.15.162:0/830254029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d3c104fd0 msgr2=0x7f5d3c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d3c104fd0 0x7f5d3c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 -- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d3c107900 msgr2=0x7f5d3c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d3c107900 0x7f5d3c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 -- 172.21.15.162:0/830254029 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c19fad0 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d3b7fe640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c197ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000e9f0 tx=0x7f5d3000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000cd80 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d300108e0 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30018920 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c19fdc0 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.023+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1a0210 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.024+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c0fdd90 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.025+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5d30010a90 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.026+0000 7f5d38ff9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5d240a3270 0x7f5d240a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.026+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f5d300cf9a0 con 0x7f5d3c1026a0 2024-09-19T08:41:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.026+0000 7f5d3affd640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5d240a3270 0x7f5d240a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:55.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.027+0000 7f5d3affd640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5d240a3270 0x7f5d240a5730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c004770 tx=0x7f5d2c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:55.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.029+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d3009ce30 con 0x7f5d3c1026a0 2024-09-19T08:41:55.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:41:55.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:41:55.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:41:55.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:55.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-19T08:41:55.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:55.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:55.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:41:55.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:54 smithi150 ceph-mon[34610]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-19T08:41:55.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:41:55.205+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5d3c062630 con 0x7f5d240a3270 2024-09-19T08:41:55.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:41:55.233+0000 7f1473b41640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T08:41:55.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:41:55.243+0000 7f146b961640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:41:55.866 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:55.866 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi150 2024-09-19T08:41:55.866 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi150 to 4272M 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:55.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:55 smithi162 ceph-mon[34870]: from='osd.10 ' entity='osd.10' 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi150 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi150 to 4272M 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:55.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:55.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:55 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' 2024-09-19T08:41:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi150 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi150 to 4272M 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:55 smithi150 ceph-mon[34610]: from='osd.10 ' entity='osd.10' 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] boot 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:41:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:56 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:56.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:41:56.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:41:56.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:56.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:56.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] boot 2024-09-19T08:41:56.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:41:56.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:57.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:41:57.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:41:57.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:57.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:57.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: osd.10 [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] boot 2024-09-19T08:41:57.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:41:57.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:56 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:57.860 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:57 smithi162 ceph-mon[34870]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:57.860 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:57 smithi162 ceph-mon[34870]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:41:57.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:57 smithi018 ceph-mon[30956]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:57.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:57 smithi018 ceph-mon[30956]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:41:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:57 smithi150 ceph-mon[34610]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:57 smithi150 ceph-mon[34610]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:41:58.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:58 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/1270118107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]: dispatch 2024-09-19T08:41:58.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:58 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]: dispatch 2024-09-19T08:41:58.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:58 smithi162 ceph-mon[34870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]': finished 2024-09-19T08:41:58.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:58 smithi162 ceph-mon[34870]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:41:58.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:58 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:58.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:58 smithi162 ceph-mon[34870]: from='client.? 172.21.15.162:0/1369401957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:58.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1270118107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]: dispatch 2024-09-19T08:41:58.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:58 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]: dispatch 2024-09-19T08:41:58.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:58 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]': finished 2024-09-19T08:41:58.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:58 smithi018 ceph-mon[30956]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:41:58.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:58.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1369401957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:59.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:58 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/1270118107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]: dispatch 2024-09-19T08:41:59.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:58 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]: dispatch 2024-09-19T08:41:59.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:58 smithi150 ceph-mon[34610]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a"}]': finished 2024-09-19T08:41:59.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:58 smithi150 ceph-mon[34610]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:41:59.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:58 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:59.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:58 smithi150 ceph-mon[34610]: from='client.? 172.21.15.162:0/1369401957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:59.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:59 smithi018 ceph-mon[30956]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:59.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:59 smithi018 ceph-mon[30956]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:41:59.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:41:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:59.966 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:59 smithi150 ceph-mon[34610]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:59.967 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:59 smithi150 ceph-mon[34610]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:41:59.967 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:41:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:00.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:59 smithi162 ceph-mon[34870]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:00.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:59 smithi162 ceph-mon[34870]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:42:00.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:41:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:00.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:00 smithi018 ceph-mon[30956]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:42:00.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:01.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:00 smithi150 ceph-mon[34610]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:42:01.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:00 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:01.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:00 smithi162 ceph-mon[34870]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:42:01.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:00 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:01.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:01 smithi018 ceph-mon[30956]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T08:42:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:01 smithi150 ceph-mon[34610]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T08:42:02.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:01 smithi162 ceph-mon[34870]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T08:42:03.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:03 smithi018 ceph-mon[30956]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T08:42:03.984 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:03 smithi162 ceph-mon[34870]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T08:42:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:03 smithi150 ceph-mon[34610]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T08:42:05.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:05 smithi018 ceph-mon[30956]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T08:42:05.992 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:05 smithi162 ceph-mon[34870]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T08:42:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:05 smithi150 ceph-mon[34610]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T08:42:06.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:42:06.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:06.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:42:06.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:07.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:42:07.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:08.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:07 smithi162 ceph-mon[34870]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:42:08.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:07 smithi162 ceph-mon[34870]: Deploying daemon osd.11 on smithi162 2024-09-19T08:42:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:07 smithi150 ceph-mon[34610]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:42:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:07 smithi150 ceph-mon[34610]: Deploying daemon osd.11 on smithi162 2024-09-19T08:42:08.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:07 smithi018 ceph-mon[30956]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:42:08.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:07 smithi018 ceph-mon[30956]: Deploying daemon osd.11 on smithi162 2024-09-19T08:42:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:09 smithi162 ceph-mon[34870]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:42:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:09 smithi150 ceph-mon[34610]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:42:10.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:09 smithi018 ceph-mon[30956]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:42:11.829 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:11 smithi162 ceph-mon[34870]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T08:42:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:11 smithi150 ceph-mon[34610]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T08:42:12.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:11 smithi018 ceph-mon[30956]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T08:42:12.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:12.911 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:12.911 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:12 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:13.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:13.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:13.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:12 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:13.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:13.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:13.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:13.976 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:13 smithi162 ceph-mon[34870]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:13 smithi150 ceph-mon[34610]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:14.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:13 smithi018 ceph-mon[30956]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:15 smithi162 ceph-mon[34870]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:15 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:15.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.966+0000 7f5d38ff9640 1 -- 172.21.15.162:0/830254029 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5d3c062630 con 0x7f5d240a3270 2024-09-19T08:42:15.967 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 11 on host 'smithi162' 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5d240a3270 msgr2=0x7f5d240a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5d240a3270 0x7f5d240a5730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c004770 tx=0x7f5d2c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 msgr2=0x7f5d3c197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c197ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000e9f0 tx=0x7f5d3000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 shutdown_connections 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5d240a3270 0x7f5d240a5730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d3c107900 0x7f5d3c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:15.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d3c104fd0 0x7f5d3c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:15.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 --2- 172.21.15.162:0/830254029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d3c1026a0 0x7f5d3c197ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:15.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 >> 172.21.15.162:0/830254029 conn(0x7f5d3c0fc2a0 msgr2=0x7f5d3c103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:15.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 shutdown_connections 2024-09-19T08:42:15.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:15.968+0000 7f5d41da9640 1 -- 172.21.15.162:0/830254029 wait complete. 2024-09-19T08:42:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:15 smithi150 ceph-mon[34610]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:16.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:16.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:15 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:15 smithi018 ceph-mon[30956]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:16.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:16.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:16.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.667 DEBUG:teuthology.orchestra.run.smithi162:osd.11> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T08:42:16.673 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T08:42:16.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:42:16.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:17.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:17.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:17.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:17.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:17.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:17.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 -- 172.21.15.18:0/2819365319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102690 msgr2=0x7fad60108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 --2- 172.21.15.18:0/2819365319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102690 0x7fad60108f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad58009ca0 tx=0x7fad5802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 -- 172.21.15.18:0/2819365319 shutdown_connections 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 --2- 172.21.15.18:0/2819365319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102690 0x7fad60108f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 --2- 172.21.15.18:0/2819365319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60101cd0 0x7fad60102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 --2- 172.21.15.18:0/2819365319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60100ad0 0x7fad60100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.458+0000 7fad66a9c640 1 -- 172.21.15.18:0/2819365319 >> 172.21.15.18:0/2819365319 conn(0x7fad600fc280 msgr2=0x7fad600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 -- 172.21.15.18:0/2819365319 shutdown_connections 2024-09-19T08:42:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 -- 172.21.15.18:0/2819365319 wait complete. 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 Processor -- start 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 -- start start 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 0x7fad60197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60101cd0 0x7fad601982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60102690 0x7fad6019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad6010c5e0 con 0x7fad60100ad0 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad6010c460 con 0x7fad60102690 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad66a9c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad6010c760 con 0x7fad60101cd0 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad64838640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 0x7fad60197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad64838640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 0x7fad60197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49448/0 (socket says 172.21.15.18:49448) 2024-09-19T08:42:17.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.459+0000 7fad64838640 1 -- 172.21.15.18:0/2108145332 learned_addr learned my addr 172.21.15.18:0/2108145332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad57fff640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60101cd0 0x7fad601982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad64838640 1 -- 172.21.15.18:0/2108145332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60101cd0 msgr2=0x7fad601982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad64838640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60101cd0 0x7fad601982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad64838640 1 -- 172.21.15.18:0/2108145332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60102690 msgr2=0x7fad6019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad65039640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60102690 0x7fad6019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad64838640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60102690 0x7fad6019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad64838640 1 -- 172.21.15.18:0/2108145332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6019f9d0 con 0x7fad60100ad0 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad57fff640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60101cd0 0x7fad601982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad65039640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60102690 0x7fad6019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad64838640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 0x7fad60197db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00d950 tx=0x7fad5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c017020 con 0x7fad60100ad0 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad5c009c30 con 0x7fad60100ad0 2024-09-19T08:42:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad66a9c640 1 -- 172.21.15.18:0/2108145332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6019fcc0 con 0x7fad60100ad0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00f6b0 con 0x7fad60100ad0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.460+0000 7fad66a9c640 1 -- 172.21.15.18:0/2108145332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601a01a0 con 0x7fad60100ad0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.462+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad40005290 con 0x7fad60100ad0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.463+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fad5c01a020 con 0x7fad60100ad0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.464+0000 7fad55ffb640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad480a32c0 0x7fad480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.464+0000 7fad57fff640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad480a32c0 0x7fad480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.464+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fad5c0cf2b0 con 0x7fad60100ad0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.464+0000 7fad57fff640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad480a32c0 0x7fad480a5780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fad50005e00 tx=0x7fad50005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.468+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad5c021020 con 0x7fad60100ad0 2024-09-19T08:42:17.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.644+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fad40005850 con 0x7fad60100ad0 2024-09-19T08:42:17.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.644+0000 7fad55ffb640 1 -- 172.21.15.18:0/2108145332 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fad5c009de0 con 0x7fad60100ad0 2024-09-19T08:42:17.645 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:17.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad480a32c0 msgr2=0x7fad480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:17.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad480a32c0 0x7fad480a5780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fad50005e00 tx=0x7fad50005c70 comp rx=0 tx=0).stop 2024-09-19T08:42:17.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 msgr2=0x7fad60197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:17.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 0x7fad60197db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00d950 tx=0x7fad5c00de10 comp rx=0 tx=0).stop 2024-09-19T08:42:17.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 shutdown_connections 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fad480a32c0 0x7fad480a5780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad60102690 0x7fad6019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad60101cd0 0x7fad601982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 --2- 172.21.15.18:0/2108145332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60100ad0 0x7fad60197db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.647+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 >> 172.21.15.18:0/2108145332 conn(0x7fad600fc280 msgr2=0x7fad60069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.648+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 shutdown_connections 2024-09-19T08:42:17.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:17.648+0000 7fad477fe640 1 -- 172.21.15.18:0/2108145332 wait complete. 2024-09-19T08:42:17.830 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:17 smithi162 ceph-mon[34870]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:17.830 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:17 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2108145332' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:17 smithi018 ceph-mon[30956]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:17 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2108145332' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:17 smithi150 ceph-mon[34610]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:17 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2108145332' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:18.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:42:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:42:18.255+0000 7fb56451f640 -1 osd.11 0 log_to_monitors true 2024-09-19T08:42:18.598 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735315,"num_in_osds":12,"osd_in_since":1726735317,"num_remapped_pgs":0} 2024-09-19T08:42:18.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:18 smithi018 ceph-mon[30956]: from='osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:42:18.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:18 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:42:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:18 smithi150 ceph-mon[34610]: from='osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:42:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:18 smithi150 ceph-mon[34610]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:42:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:18 smithi162 ceph-mon[34870]: from='osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:42:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:18 smithi162 ceph-mon[34870]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:42:19.599 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:42:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:19.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:42:19.728+0000 7fb5604a2640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T08:42:19.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:42:19.739+0000 7fb55c2ca640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:42:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:42:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:42:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:19.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:19.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:42:19.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:42:19.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:19.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:19.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:20.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:42:20.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:20.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:20.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:20.067 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 -- 172.21.15.18:0/3404745773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d01037c0 msgr2=0x7f82d010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 --2- 172.21.15.18:0/3404745773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d01037c0 0x7f82d010a050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009ca0 tx=0x7f82c802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 -- 172.21.15.18:0/3404745773 shutdown_connections 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 --2- 172.21.15.18:0/3404745773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d01037c0 0x7f82d010a050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 --2- 172.21.15.18:0/3404745773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d0102e00 0x7f82d0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 --2- 172.21.15.18:0/3404745773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82d0101c00 0x7f82d0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 -- 172.21.15.18:0/3404745773 >> 172.21.15.18:0/3404745773 conn(0x7f82d00fd390 msgr2=0x7f82d00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 -- 172.21.15.18:0/3404745773 shutdown_connections 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.454+0000 7f82d56d7640 1 -- 172.21.15.18:0/3404745773 wait complete. 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 Processor -- start 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 -- start start 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 0x7f82d0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d0102e00 0x7f82d0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82d01037c0 0x7f82d019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010d730 con 0x7f82d0101c00 2024-09-19T08:42:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010d5b0 con 0x7f82d01037c0 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82d56d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010d8b0 con 0x7f82d0102e00 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82ceffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 0x7f82d0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82ceffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 0x7f82d0197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56694/0 (socket says 172.21.15.18:56694) 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82ceffd640 1 -- 172.21.15.18:0/2671017065 learned_addr learned my addr 172.21.15.18:0/2671017065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.455+0000 7f82c7fff640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d0102e00 0x7f82d0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82cf7fe640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82d01037c0 0x7f82d019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ceffd640 1 -- 172.21.15.18:0/2671017065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d0102e00 msgr2=0x7f82d0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ceffd640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d0102e00 0x7f82d0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ceffd640 1 -- 172.21.15.18:0/2671017065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82d01037c0 msgr2=0x7f82d019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ceffd640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82d01037c0 0x7f82d019f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ceffd640 1 -- 172.21.15.18:0/2671017065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d019f9f0 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ceffd640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 0x7f82d0197dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d770 tx=0x7f82c000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0017070 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82c0009c30 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d019fce0 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0003d00 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.456+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d01a0170 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.457+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d0109050 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.458+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f82c0003ea0 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.459+0000 7f82ccff9640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f82bc0a3270 0x7f82bc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.459+0000 7f82c7fff640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f82bc0a3270 0x7f82bc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.460+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7f82c00cecb0 con 0x7f82d0101c00 2024-09-19T08:42:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.460+0000 7f82c7fff640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f82bc0a3270 0x7f82bc0a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82d01992e0 tx=0x7f82b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.464+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82c009bf90 con 0x7f82d0101c00 2024-09-19T08:42:20.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.639+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f82d0062ef0 con 0x7f82d0101c00 2024-09-19T08:42:20.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.639+0000 7f82ccff9640 1 -- 172.21.15.18:0/2671017065 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f82c009b890 con 0x7f82d0101c00 2024-09-19T08:42:20.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f82bc0a3270 msgr2=0x7f82bc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f82bc0a3270 0x7f82bc0a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82d01992e0 tx=0x7f82b800b390 comp rx=0 tx=0).stop 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 msgr2=0x7f82d0197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 0x7f82d0197dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d770 tx=0x7f82c000dc30 comp rx=0 tx=0).stop 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 shutdown_connections 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f82bc0a3270 0x7f82bc0a5730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82d01037c0 0x7f82d019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d0102e00 0x7f82d0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 --2- 172.21.15.18:0/2671017065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d0101c00 0x7f82d0197dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 >> 172.21.15.18:0/2671017065 conn(0x7f82d00fd390 msgr2=0x7f82d0106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 shutdown_connections 2024-09-19T08:42:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:20.641+0000 7f82d56d7640 1 -- 172.21.15.18:0/2671017065 wait complete. 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2671017065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: Detected new or changed devices on smithi162 2024-09-19T08:42:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T08:42:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:42:21.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:42:21.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:21.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:21.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:20 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2671017065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: Detected new or changed devices on smithi162 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:21.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:20 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2671017065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:21.301 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735315,"num_in_osds":12,"osd_in_since":1726735317,"num_remapped_pgs":0} 2024-09-19T08:42:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:21 smithi150 ceph-mon[34610]: purged_snaps scrub starts 2024-09-19T08:42:22.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:21 smithi150 ceph-mon[34610]: purged_snaps scrub ok 2024-09-19T08:42:22.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:21 smithi150 ceph-mon[34610]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:22.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:21 smithi150 ceph-mon[34610]: osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] boot 2024-09-19T08:42:22.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:21 smithi150 ceph-mon[34610]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:42:22.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:22.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:21 smithi162 ceph-mon[34870]: purged_snaps scrub starts 2024-09-19T08:42:22.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:21 smithi162 ceph-mon[34870]: purged_snaps scrub ok 2024-09-19T08:42:22.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:21 smithi162 ceph-mon[34870]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:22.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:21 smithi162 ceph-mon[34870]: osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] boot 2024-09-19T08:42:22.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:21 smithi162 ceph-mon[34870]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:42:22.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:22.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:21 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T08:42:22.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:21 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T08:42:22.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:21 smithi018 ceph-mon[30956]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:42:22.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:21 smithi018 ceph-mon[30956]: osd.11 [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] boot 2024-09-19T08:42:22.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:21 smithi018 ceph-mon[30956]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:42:22.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:42:22.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:42:22.568 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:22.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:22 smithi018 ceph-mon[30956]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:42:23.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:22 smithi150 ceph-mon[34610]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:42:23.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 -- 172.21.15.18:0/774144849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0102660 msgr2=0x7f48b0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 --2- 172.21.15.18:0/774144849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0102660 0x7f48b0104a50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009900 tx=0x7f48a002a410 comp rx=0 tx=0).stop 2024-09-19T08:42:23.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 -- 172.21.15.18:0/774144849 shutdown_connections 2024-09-19T08:42:23.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 --2- 172.21.15.18:0/774144849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b01078c0 0x7f48b0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 --2- 172.21.15.18:0/774144849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0104f90 0x7f48b0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 --2- 172.21.15.18:0/774144849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0102660 0x7f48b0104a50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 -- 172.21.15.18:0/774144849 >> 172.21.15.18:0/774144849 conn(0x7f48b00fc280 msgr2=0x7f48b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 -- 172.21.15.18:0/774144849 shutdown_connections 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 -- 172.21.15.18:0/774144849 wait complete. 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.055+0000 7f48b6178640 1 Processor -- start 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 -- start start 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0102660 0x7f48b0101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b0104f90 0x7f48b0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 0x7f48b0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f48b010d790 con 0x7f48b01078c0 2024-09-19T08:42:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f48b010d610 con 0x7f48b0104f90 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48b6178640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48b010d910 con 0x7f48b0102660 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 0x7f48b0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 0x7f48b0100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56710/0 (socket says 172.21.15.18:56710) 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 -- 172.21.15.18:0/1594746707 learned_addr learned my addr 172.21.15.18:0/1594746707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48aeffd640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b0104f90 0x7f48b0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48af7fe640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0102660 0x7f48b0101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 -- 172.21.15.18:0/1594746707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0102660 msgr2=0x7f48b0101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0102660 0x7f48b0101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 -- 172.21.15.18:0/1594746707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b0104f90 msgr2=0x7f48b0100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b0104f90 0x7f48b0100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 -- 172.21.15.18:0/1594746707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b0101410 con 0x7f48b01078c0 2024-09-19T08:42:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48af7fe640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0102660 0x7f48b0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.056+0000 7f48affff640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 0x7f48b0100b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f48a800eaa0 tx=0x7f48a800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.057+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8004d20 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.057+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48a8005020 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.057+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b01a1fe0 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.057+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a80116b0 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.057+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b01a24c0 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.058+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b00fdd70 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.059+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f48a80051d0 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.060+0000 7f48acff9640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48980a3240 0x7f48980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.060+0000 7f48af7fe640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48980a3240 0x7f48980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.060+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f48a80cf6b0 con 0x7f48b01078c0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.060+0000 7f48af7fe640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48980a3240 0x7f48980a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f48a00314e0 tx=0x7f48a0032d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.064+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48a8016030 con 0x7f48b01078c0 2024-09-19T08:42:23.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:22 smithi162 ceph-mon[34870]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:42:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.242+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f48b002da10 con 0x7f48b01078c0 2024-09-19T08:42:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.243+0000 7f48acff9640 1 -- 172.21.15.18:0/1594746707 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f48a809c870 con 0x7f48b01078c0 2024-09-19T08:42:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48980a3240 msgr2=0x7f48980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48980a3240 0x7f48980a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f48a00314e0 tx=0x7f48a0032d40 comp rx=0 tx=0).stop 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 msgr2=0x7f48b0100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 0x7f48b0100b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f48a800eaa0 tx=0x7f48a800eea0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 shutdown_connections 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48980a3240 0x7f48980a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b01078c0 0x7f48b0100b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b0104f90 0x7f48b0100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 --2- 172.21.15.18:0/1594746707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0102660 0x7f48b0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 >> 172.21.15.18:0/1594746707 conn(0x7f48b00fc280 msgr2=0x7f48b01030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 shutdown_connections 2024-09-19T08:42:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:23.245+0000 7f48b6178640 1 -- 172.21.15.18:0/1594746707 wait complete. 2024-09-19T08:42:23.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:23 smithi018 ceph-mon[30956]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:23.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:23 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1594746707' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:23.966 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726735340,"num_in_osds":12,"osd_in_since":1726735317,"num_remapped_pgs":0} 2024-09-19T08:42:23.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:42:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:23 smithi150 ceph-mon[34610]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:23 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1594746707' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:24.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:23 smithi162 ceph-mon[34870]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:24.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:23 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1594746707' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:42:24.217 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 -- 172.21.15.18:0/3701151025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 msgr2=0x7feae41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 --2- 172.21.15.18:0/3701151025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41029b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fead8009900 tx=0x7fead802a480 comp rx=0 tx=0).stop 2024-09-19T08:42:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 -- 172.21.15.18:0/3701151025 shutdown_connections 2024-09-19T08:42:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 --2- 172.21.15.18:0/3701151025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4102ef0 0x7feae410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 --2- 172.21.15.18:0/3701151025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41029b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 --2- 172.21.15.18:0/3701151025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4100e20 0x7feae4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 -- 172.21.15.18:0/3701151025 >> 172.21.15.18:0/3701151025 conn(0x7feae40fc7d0 msgr2=0x7feae40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 -- 172.21.15.18:0/3701151025 shutdown_connections 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.782+0000 7feae89d5640 1 -- 172.21.15.18:0/3701151025 wait complete. 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 Processor -- start 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 -- start start 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4100e20 0x7feae41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4102ef0 0x7feae419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feae4110e50 con 0x7feae4102570 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feae4110cd0 con 0x7feae4102ef0 2024-09-19T08:42:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae89d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feae4110fd0 con 0x7feae4100e20 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56728/0 (socket says 172.21.15.18:56728) 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 -- 172.21.15.18:0/3683323572 learned_addr learned my addr 172.21.15.18:0/3683323572 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae2d9d640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4102ef0 0x7feae419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae259c640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4100e20 0x7feae41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 -- 172.21.15.18:0/3683323572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4100e20 msgr2=0x7feae41972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4100e20 0x7feae41972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 -- 172.21.15.18:0/3683323572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4102ef0 msgr2=0x7feae419bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4102ef0 0x7feae419bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.783+0000 7feae1d9b640 1 -- 172.21.15.18:0/3683323572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae419c260 con 0x7feae4102570 2024-09-19T08:42:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.784+0000 7feae1d9b640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41977f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fead8004770 tx=0x7fead8003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.784+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead803f070 con 0x7feae4102570 2024-09-19T08:42:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.784+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae419c4f0 con 0x7feae4102570 2024-09-19T08:42:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.784+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fead803bd20 con 0x7feae4102570 2024-09-19T08:42:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.784+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8035030 con 0x7feae4102570 2024-09-19T08:42:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.784+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae41a3e30 con 0x7feae4102570 2024-09-19T08:42:24.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.785+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae4101200 con 0x7feae4102570 2024-09-19T08:42:24.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.786+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fead8042070 con 0x7feae4102570 2024-09-19T08:42:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.787+0000 7fead37fe640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7feacc0a3240 0x7feacc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.787+0000 7feae259c640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7feacc0a3240 0x7feacc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.787+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fead80ef840 con 0x7feae4102570 2024-09-19T08:42:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.788+0000 7feae259c640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7feacc0a3240 0x7feacc0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fead4005d00 tx=0x7fead400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:24.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.792+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fead80bc3b0 con 0x7feae4102570 2024-09-19T08:42:24.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.967+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feae4109090 con 0x7feae4102570 2024-09-19T08:42:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:24 smithi018 ceph-mon[30956]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.968+0000 7fead37fe640 1 -- 172.21.15.18:0/3683323572 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18505 (secure 0 0 0) 0x7fead80c06b0 con 0x7feae4102570 2024-09-19T08:42:24.969 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:24.969 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":75,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:42:21.736673+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7feacc0a3240 msgr2=0x7feacc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7feacc0a3240 0x7feacc0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fead4005d00 tx=0x7fead400b410 comp rx=0 tx=0).stop 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 msgr2=0x7feae41977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41977f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fead8004770 tx=0x7fead8003ca0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 shutdown_connections 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7feacc0a3240 0x7feacc0a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4102ef0 0x7feae419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae4102570 0x7feae41977f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 --2- 172.21.15.18:0/3683323572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4100e20 0x7feae41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:24.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 >> 172.21.15.18:0/3683323572 conn(0x7feae40fc7d0 msgr2=0x7feae40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:24.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 shutdown_connections 2024-09-19T08:42:24.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:24.970+0000 7feae89d5640 1 -- 172.21.15.18:0/3683323572 wait complete. 2024-09-19T08:42:25.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:24 smithi150 ceph-mon[34610]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:25.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:24 smithi162 ceph-mon[34870]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:25.782 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:38:34.272105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:42:25.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:42:26.038 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:26.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:25 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3683323572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:26.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:25 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3683323572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:26.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:25 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3683323572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 -- 172.21.15.18:0/2461288979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8102790 msgr2=0x7f06f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 --2- 172.21.15.18:0/2461288979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8102790 0x7f06f81067e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009900 tx=0x7f06e802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 -- 172.21.15.18:0/2461288979 shutdown_connections 2024-09-19T08:42:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 --2- 172.21.15.18:0/2461288979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 0x7f06f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 --2- 172.21.15.18:0/2461288979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8102790 0x7f06f81067e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 --2- 172.21.15.18:0/2461288979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8101de0 0x7f06f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 -- 172.21.15.18:0/2461288979 >> 172.21.15.18:0/2461288979 conn(0x7f06f80fd8c0 msgr2=0x7f06f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 -- 172.21.15.18:0/2461288979 shutdown_connections 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.563+0000 7f06ff536640 1 -- 172.21.15.18:0/2461288979 wait complete. 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 Processor -- start 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 -- start start 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 0x7f06f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8102790 0x7f06f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 0x7f06f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8111e20 con 0x7f06f8101de0 2024-09-19T08:42:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8111ca0 con 0x7f06f8106f10 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06ff536640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8111fa0 con 0x7f06f8102790 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06fd2d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 0x7f06f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06fd2d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 0x7f06f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56740/0 (socket says 172.21.15.18:56740) 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06fd2d2640 1 -- 172.21.15.18:0/937003275 learned_addr learned my addr 172.21.15.18:0/937003275 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.564+0000 7f06fcad1640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8102790 0x7f06f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fdad3640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 0x7f06f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fd2d2640 1 -- 172.21.15.18:0/937003275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8102790 msgr2=0x7f06f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fd2d2640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8102790 0x7f06f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fd2d2640 1 -- 172.21.15.18:0/937003275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 msgr2=0x7f06f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fd2d2640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 0x7f06f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fd2d2640 1 -- 172.21.15.18:0/937003275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81a67e0 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fcad1640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8102790 0x7f06f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fdad3640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 0x7f06f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06fd2d2640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 0x7f06f80744f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06f400d950 tx=0x7f06f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4017070 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06f4009c30 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f81a6ad0 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f400f620 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.565+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f81a6fe0 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.566+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f81021c0 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.567+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f06f40109a0 con 0x7f06f8101de0 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.568+0000 7f06ee7fc640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f06e40a3240 0x7f06e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:26.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.569+0000 7f06fcad1640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f06e40a3240 0x7f06e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.569+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f06f40cf1d0 con 0x7f06f8101de0 2024-09-19T08:42:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.569+0000 7f06fcad1640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f06e40a3240 0x7f06e40a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f06e8031440 tx=0x7f06e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.572+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06f4009de0 con 0x7f06f8101de0 2024-09-19T08:42:26.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.750+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f06f810a150 con 0x7f06f8101de0 2024-09-19T08:42:26.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.750+0000 7f06ee7fc640 1 -- 172.21.15.18:0/937003275 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f06f409c2f0 con 0x7f06f8101de0 2024-09-19T08:42:26.751 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.752+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f06e40a3240 msgr2=0x7f06e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.752+0000 7f06ff536640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f06e40a3240 0x7f06e40a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f06e8031440 tx=0x7f06e8005a20 comp rx=0 tx=0).stop 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.752+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 msgr2=0x7f06f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.752+0000 7f06ff536640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 0x7f06f80744f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06f400d950 tx=0x7f06f400de10 comp rx=0 tx=0).stop 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 shutdown_connections 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f06e40a3240 0x7f06e40a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f8106f10 0x7f06f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06f8102790 0x7f06f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 --2- 172.21.15.18:0/937003275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f8101de0 0x7f06f80744f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 >> 172.21.15.18:0/937003275 conn(0x7f06f80fd8c0 msgr2=0x7f06f80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 shutdown_connections 2024-09-19T08:42:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:26.753+0000 7f06ff536640 1 -- 172.21.15.18:0/937003275 wait complete. 2024-09-19T08:42:27.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:26 smithi150 ceph-mon[34610]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:27.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:26 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/937003275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:42:27.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:26 smithi018 ceph-mon[30956]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:27.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/937003275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:42:27.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:26 smithi162 ceph-mon[34870]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:27.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:26 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/937003275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:42:27.574 INFO:tasks.cephadm:Adding mds.a on smithi018 2024-09-19T08:42:27.574 INFO:tasks.cephadm:Adding mds.d on smithi018 2024-09-19T08:42:27.574 INFO:tasks.cephadm:Adding mds.g on smithi018 2024-09-19T08:42:27.574 INFO:tasks.cephadm:Adding mds.j on smithi018 2024-09-19T08:42:27.574 INFO:tasks.cephadm:Adding mds.b on smithi150 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.e on smithi150 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.h on smithi150 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.k on smithi150 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.c on smithi162 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.f on smithi162 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.i on smithi162 2024-09-19T08:42:27.575 INFO:tasks.cephadm:Adding mds.l on smithi162 2024-09-19T08:42:27.575 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l' 2024-09-19T08:42:27.835 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:42:28.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3197136524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94100ad0 msgr2=0x7f2d94100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:28.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3197136524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94100ad0 0x7f2d94100ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009900 tx=0x7f2d8802a410 comp rx=0 tx=0).stop 2024-09-19T08:42:28.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3197136524 shutdown_connections 2024-09-19T08:42:28.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3197136524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 0x7f2d94108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3197136524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d94101cd0 0x7f2d94102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3197136524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94100ad0 0x7f2d94100ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3197136524 >> 172.21.15.162:0/3197136524 conn(0x7f2d940fc280 msgr2=0x7f2d940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3197136524 shutdown_connections 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3197136524 wait complete. 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.327+0000 7f2d99d8b640 1 Processor -- start 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 -- start start 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d94100ad0 0x7f2d9406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 0x7f2d9419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 0x7f2d9419f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9410c5e0 con 0x7f2d94102690 2024-09-19T08:42:28.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9410c460 con 0x7f2d94100ad0 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d99d8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9410c760 con 0x7f2d94101cd0 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 0x7f2d9419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 0x7f2d9419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44602/0 (socket says 172.21.15.162:44602) 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 -- 172.21.15.162:0/3881185727 learned_addr learned my addr 172.21.15.162:0/3881185727 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d937fe640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d94100ad0 0x7f2d9406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d93fff640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 0x7f2d9419f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 -- 172.21.15.162:0/3881185727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d94100ad0 msgr2=0x7f2d9406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d94100ad0 0x7f2d9406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 -- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 msgr2=0x7f2d9419f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 0x7f2d9419f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d92ffd640 1 -- 172.21.15.162:0/3881185727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9419fab0 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.328+0000 7f2d93fff640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 0x7f2d9419f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.329+0000 7f2d92ffd640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 0x7f2d9419cb80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400d950 tx=0x7f2d8400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.329+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d84017070 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.329+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9419fd40 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.329+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d84009c30 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.329+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400f620 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.329+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d941a0270 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.330+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d94108010 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.331+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2d840109a0 con 0x7f2d94101cd0 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.331+0000 7f2d90ff9640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2d7c0a3240 0x7f2d7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:28.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.332+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2d840cf150 con 0x7f2d94101cd0 2024-09-19T08:42:28.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.332+0000 7f2d937fe640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2d7c0a3240 0x7f2d7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:28.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.332+0000 7f2d937fe640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2d7c0a3240 0x7f2d7c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000c00 tx=0x7f2d880314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:28.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.336+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d84009de0 con 0x7f2d94101cd0 2024-09-19T08:42:28.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.541+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}) -- 0x7f2d940627f0 con 0x7f2d7c0a3240 2024-09-19T08:42:28.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.550+0000 7f2d90ff9640 1 -- 172.21.15.162:0/3881185727 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2d940627f0 con 0x7f2d7c0a3240 2024-09-19T08:42:28.549 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mds.all update... 2024-09-19T08:42:28.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2d7c0a3240 msgr2=0x7f2d7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:28.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2d7c0a3240 0x7f2d7c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000c00 tx=0x7f2d880314a0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 msgr2=0x7f2d9419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:28.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 0x7f2d9419cb80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400d950 tx=0x7f2d8400de10 comp rx=0 tx=0).stop 2024-09-19T08:42:28.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 shutdown_connections 2024-09-19T08:42:28.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2d7c0a3240 0x7f2d7c0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d94102690 0x7f2d9419f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d94101cd0 0x7f2d9419cb80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 --2- 172.21.15.162:0/3881185727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d94100ad0 0x7f2d9406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:28.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 >> 172.21.15.162:0/3881185727 conn(0x7f2d940fc280 msgr2=0x7f2d941051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:28.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 shutdown_connections 2024-09-19T08:42:28.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T08:42:28.552+0000 7f2d99d8b640 1 -- 172.21.15.162:0/3881185727 wait complete. 2024-09-19T08:42:29.338 DEBUG:teuthology.orchestra.run.smithi018:mds.a> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T08:42:29.341 DEBUG:teuthology.orchestra.run.smithi018:mds.d> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T08:42:29.384 DEBUG:teuthology.orchestra.run.smithi018:mds.g> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T08:42:29.427 DEBUG:teuthology.orchestra.run.smithi018:mds.j> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T08:42:29.470 DEBUG:teuthology.orchestra.run.smithi150:mds.b> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T08:42:29.473 DEBUG:teuthology.orchestra.run.smithi150:mds.e> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T08:42:29.516 DEBUG:teuthology.orchestra.run.smithi150:mds.h> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T08:42:29.558 DEBUG:teuthology.orchestra.run.smithi150:mds.k> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T08:42:29.601 DEBUG:teuthology.orchestra.run.smithi162:mds.c> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T08:42:29.604 DEBUG:teuthology.orchestra.run.smithi162:mds.f> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:29 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:29.626 DEBUG:teuthology.orchestra.run.smithi162:mds.i> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T08:42:29.670 DEBUG:teuthology.orchestra.run.smithi162:mds.l> sudo journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:29.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:29.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:29.713 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T08:42:29.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:29.769 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:29.770 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:29 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:29.969 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:30.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 -- 172.21.15.18:0/4163606122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0101de0 msgr2=0x7f10e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:30.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/4163606122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0101de0 0x7f10e01021c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009900 tx=0x7f10d802a410 comp rx=0 tx=0).stop 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 -- 172.21.15.18:0/4163606122 shutdown_connections 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/4163606122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0106f10 0x7f10e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/4163606122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0102790 0x7f10e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/4163606122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0101de0 0x7f10e01021c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.440+0000 7f10e4bb0640 1 -- 172.21.15.18:0/4163606122 >> 172.21.15.18:0/4163606122 conn(0x7f10e00fd8c0 msgr2=0x7f10e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.441+0000 7f10e4bb0640 1 -- 172.21.15.18:0/4163606122 shutdown_connections 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.441+0000 7f10e4bb0640 1 -- 172.21.15.18:0/4163606122 wait complete. 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.441+0000 7f10e4bb0640 1 Processor -- start 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.441+0000 7f10e4bb0640 1 -- start start 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.441+0000 7f10e4bb0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0101de0 0x7f10e0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.441+0000 7f10e4bb0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 0x7f10e0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10e4bb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0106f10 0x7f10e019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10e4bb0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0111ec0 con 0x7f10e0102790 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10e4bb0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0111d40 con 0x7f10e0101de0 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10e4bb0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0112040 con 0x7f10e0106f10 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 0x7f10e0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 0x7f10e0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59706/0 (socket says 172.21.15.18:59706) 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 -- 172.21.15.18:0/2662362096 learned_addr learned my addr 172.21.15.18:0/2662362096 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10de59c640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0101de0 0x7f10e0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ded9d640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0106f10 0x7f10e019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 -- 172.21.15.18:0/2662362096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0106f10 msgr2=0x7f10e019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0106f10 0x7f10e019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 -- 172.21.15.18:0/2662362096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0101de0 msgr2=0x7f10e0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0101de0 0x7f10e0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 -- 172.21.15.18:0/2662362096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e019d4d0 con 0x7f10e0102790 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ded9d640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0106f10 0x7f10e019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10de59c640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0101de0 0x7f10e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10ddd9b640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 0x7f10e0198a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10c800b4a0 tx=0x7f10c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.442+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8014070 con 0x7f10e0102790 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.443+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e019d7c0 con 0x7f10e0102790 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.443+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10c8010ac0 con 0x7f10e0102790 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.443+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8017c30 con 0x7f10e0102790 2024-09-19T08:42:30.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.443+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e01a50a0 con 0x7f10e0102790 2024-09-19T08:42:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.444+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e0102240 con 0x7f10e0102790 2024-09-19T08:42:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.445+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f10c8017070 con 0x7f10e0102790 2024-09-19T08:42:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.446+0000 7f10d77fe640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10cc0a3240 0x7f10cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.446+0000 7f10de59c640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10cc0a3240 0x7f10cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.446+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f10c80ce910 con 0x7f10e0102790 2024-09-19T08:42:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.446+0000 7f10de59c640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10cc0a3240 0x7f10cc0a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10d8031440 tx=0x7f10d80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:30.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.450+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10c809bad0 con 0x7f10e0102790 2024-09-19T08:42:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.666+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10e002d7c0 con 0x7f10e0102790 2024-09-19T08:42:30.666 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:30 smithi018 ceph-mon[30956]: Deploying daemon mds.l on smithi162 2024-09-19T08:42:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.666+0000 7f10d77fe640 1 -- 172.21.15.18:0/2662362096 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f10c809b3d0 con 0x7f10e0102790 2024-09-19T08:42:30.667 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:30.667 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":1,"btime":"2024-09-19T08:35:30:772232+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T08:42:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 1 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10cc0a3240 msgr2=0x7f10cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10cc0a3240 0x7f10cc0a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10d8031440 tx=0x7f10d80095f0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 msgr2=0x7f10e0198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 0x7f10e0198a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10c800b4a0 tx=0x7f10c800b960 comp rx=0 tx=0).stop 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 shutdown_connections 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10cc0a3240 0x7f10cc0a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0106f10 0x7f10e019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e0102790 0x7f10e0198a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 --2- 172.21.15.18:0/2662362096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10e0101de0 0x7f10e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 >> 172.21.15.18:0/2662362096 conn(0x7f10e00fd8c0 msgr2=0x7f10e00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 shutdown_connections 2024-09-19T08:42:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:30.668+0000 7f10e4bb0640 1 -- 172.21.15.18:0/2662362096 wait complete. 2024-09-19T08:42:30.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:30 smithi162 ceph-mon[34870]: Deploying daemon mds.l on smithi162 2024-09-19T08:42:30.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:30 smithi150 ceph-mon[34610]: Deploying daemon mds.l on smithi162 2024-09-19T08:42:31.167 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:30 smithi162 systemd[1]: Starting Ceph mds.l for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:31.459 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 podman[64419]: 2024-09-19 08:42:31.106042622 +0000 UTC m=+0.015720124 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:31.459 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 podman[64419]: 2024-09-19 08:42:31.223496016 +0000 UTC m=+0.133173502 container create 19be58d02b9216a75f4a0229248b4f78dc0e88006ac073b68772f0c040ec0676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:42:31.459 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 podman[64419]: 2024-09-19 08:42:31.459457926 +0000 UTC m=+0.369135422 container init 19be58d02b9216a75f4a0229248b4f78dc0e88006ac073b68772f0c040ec0676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:42:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:31 smithi150 ceph-mon[34610]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:31 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2662362096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:31 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.162:6832/365177303,v1:172.21.15.162:6833/365177303] up:boot 2024-09-19T08:42:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:31 smithi150 ceph-mon[34610]: fsmap 1 up:standby 2024-09-19T08:42:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:31 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-mon[34870]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2662362096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.162:6832/365177303,v1:172.21.15.162:6833/365177303] up:boot 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-mon[34870]: fsmap 1 up:standby 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 podman[64419]: 2024-09-19 08:42:31.462416476 +0000 UTC m=+0.372093963 container start 19be58d02b9216a75f4a0229248b4f78dc0e88006ac073b68772f0c040ec0676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-mds[64438]: -- 172.21.15.162:0/3461279257 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9346ab860 con 0x55c934689400 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l[64434]: starting mds.l at 2024-09-19T08:42:31.917 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 bash[64419]: 19be58d02b9216a75f4a0229248b4f78dc0e88006ac073b68772f0c040ec0676 2024-09-19T08:42:31.918 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:42:31 smithi162 systemd[1]: Started Ceph mds.l for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:31.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:31 smithi018 ceph-mon[30956]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:31 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2662362096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6832/365177303,v1:172.21.15.162:6833/365177303] up:boot 2024-09-19T08:42:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:31 smithi018 ceph-mon[30956]: fsmap 1 up:standby 2024-09-19T08:42:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:32.739 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:32 smithi150 ceph-mon[34610]: Deploying daemon mds.k on smithi150 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:32.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:32 smithi162 ceph-mon[34870]: Deploying daemon mds.k on smithi150 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:32.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:32 smithi018 ceph-mon[30956]: Deploying daemon mds.k on smithi150 2024-09-19T08:42:33.493 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:33.759 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:33.808 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:33 smithi150 ceph-mon[34610]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:33.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:33 smithi018 ceph-mon[30956]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:33.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:33 smithi162 ceph-mon[34870]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 -- 172.21.15.18:0/2713658945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 msgr2=0x7f5c9410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/2713658945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9410ea80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009ca0 tx=0x7f5c8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 -- 172.21.15.18:0/2713658945 shutdown_connections 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/2713658945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9410ea80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/2713658945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94102780 0x7f5c941067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/2713658945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c94101dd0 0x7f5c941021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 -- 172.21.15.18:0/2713658945 >> 172.21.15.18:0/2713658945 conn(0x7f5c940fd8b0 msgr2=0x7f5c940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 -- 172.21.15.18:0/2713658945 shutdown_connections 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.255+0000 7f5c9aaea640 1 -- 172.21.15.18:0/2713658945 wait complete. 2024-09-19T08:42:34.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 Processor -- start 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 -- start start 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94101dd0 0x7f5c941982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c94102780 0x7f5c94198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111e10 con 0x7f5c94106f00 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111c90 con 0x7f5c94101dd0 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c9aaea640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111f90 con 0x7f5c94102780 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c99087640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c99087640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59732/0 (socket says 172.21.15.18:59732) 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c99087640 1 -- 172.21.15.18:0/1096168177 learned_addr learned my addr 172.21.15.18:0/1096168177 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c93fff640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c94102780 0x7f5c94198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:34.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.256+0000 7f5c98886640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94101dd0 0x7f5c941982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c99087640 1 -- 172.21.15.18:0/1096168177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c94102780 msgr2=0x7f5c94198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c99087640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c94102780 0x7f5c94198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c99087640 1 -- 172.21.15.18:0/1096168177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94101dd0 msgr2=0x7f5c941982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c99087640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94101dd0 0x7f5c941982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c99087640 1 -- 172.21.15.18:0/1096168177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9419d2a0 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c99087640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9419cbc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009dc0 tx=0x7f5c8c032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c003cf0 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9419d530 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c8c0044f0 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c030bf0 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.257+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c941a4e70 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.258+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c941021b0 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.259+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5c8c004040 con 0x7f5c94106f00 2024-09-19T08:42:34.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.260+0000 7f5c91ffb640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5c840a32c0 0x7f5c840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:34.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.260+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5c8c0f0a10 con 0x7f5c94106f00 2024-09-19T08:42:34.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.260+0000 7f5c98886640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5c840a32c0 0x7f5c840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:34.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.261+0000 7f5c98886640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5c840a32c0 0x7f5c840a5780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800bbe0 tx=0x7f5c8800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:34.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.265+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c8c0bdb30 con 0x7f5c94106f00 2024-09-19T08:42:34.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.481+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c9402d7c0 con 0x7f5c94106f00 2024-09-19T08:42:34.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.482+0000 7f5c91ffb640 1 -- 172.21.15.18:0/1096168177 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f5c8c0bd430 con 0x7f5c94106f00 2024-09-19T08:42:34.483 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:34.483 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"btime":"2024-09-19T08:42:31:491342+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:42:34.483 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5c840a32c0 msgr2=0x7f5c840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5c840a32c0 0x7f5c840a5780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800bbe0 tx=0x7f5c8800b390 comp rx=0 tx=0).stop 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 msgr2=0x7f5c9419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9419cbc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009dc0 tx=0x7f5c8c032ff0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 shutdown_connections 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5c840a32c0 0x7f5c840a5780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c94106f00 0x7f5c9419cbc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c94102780 0x7f5c94198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 --2- 172.21.15.18:0/1096168177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94101dd0 0x7f5c941982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:34.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.484+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 >> 172.21.15.18:0/1096168177 conn(0x7f5c940fd8b0 msgr2=0x7f5c940fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:34.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.485+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 shutdown_connections 2024-09-19T08:42:34.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:34.485+0000 7f5c9aaea640 1 -- 172.21.15.18:0/1096168177 wait complete. 2024-09-19T08:42:34.565 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:42:34 smithi150 systemd[1]: Started Ceph mds.k for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:35.488 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: Deploying daemon mds.j on smithi018 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1096168177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.150:6832/444164547,v1:172.21.15.150:6833/444164547] up:boot 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: fsmap 2 up:standby 2024-09-19T08:42:35.489 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:35 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: Deploying daemon mds.j on smithi018 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1096168177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:35.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.150:6832/444164547,v1:172.21.15.150:6833/444164547] up:boot 2024-09-19T08:42:35.569 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: fsmap 2 up:standby 2024-09-19T08:42:35.569 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: Deploying daemon mds.j on smithi018 2024-09-19T08:42:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1096168177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:35.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.150:6832/444164547,v1:172.21.15.150:6833/444164547] up:boot 2024-09-19T08:42:35.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: fsmap 2 up:standby 2024-09-19T08:42:35.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:35 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:42:37.194 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 systemd[1]: Starting Ceph mds.j for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:37.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:37.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:37 smithi018 ceph-mon[30956]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:37.445 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 podman[69833]: 2024-09-19 08:42:37.185950308 +0000 UTC m=+0.016473156 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:37.446 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 podman[69833]: 2024-09-19 08:42:37.313545636 +0000 UTC m=+0.144068467 container create 9078a9be863aa4d66e883247a63b092b9e4e7caa5ee4e4477c06e8f307d26dea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T08:42:37.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:37 smithi150 ceph-mon[34610]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:37.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:37 smithi162 ceph-mon[34870]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:37.787 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:37.910 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 podman[69833]: 2024-09-19 08:42:37.566652174 +0000 UTC m=+0.397175018 container init 9078a9be863aa4d66e883247a63b092b9e4e7caa5ee4e4477c06e8f307d26dea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:42:37.910 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 podman[69833]: 2024-09-19 08:42:37.570054142 +0000 UTC m=+0.400576974 container start 9078a9be863aa4d66e883247a63b092b9e4e7caa5ee4e4477c06e8f307d26dea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:42:37.911 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 ceph-mds[69883]: -- 172.21.15.18:0/1722343673 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c4ab9d860 con 0x557c4ab7a800 2024-09-19T08:42:37.911 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j[69867]: starting mds.j at 2024-09-19T08:42:37.911 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 bash[69833]: 9078a9be863aa4d66e883247a63b092b9e4e7caa5ee4e4477c06e8f307d26dea 2024-09-19T08:42:37.911 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:42:37 smithi018 systemd[1]: Started Ceph mds.j for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:38.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.296+0000 7f05d19b9640 1 -- 172.21.15.18:0/1235648483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc102790 msgr2=0x7f05cc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:38.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.296+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1235648483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc102790 0x7f05cc1067e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009900 tx=0x7f05b402a410 comp rx=0 tx=0).stop 2024-09-19T08:42:38.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- 172.21.15.18:0/1235648483 shutdown_connections 2024-09-19T08:42:38.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1235648483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05cc106f10 0x7f05cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1235648483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc102790 0x7f05cc1067e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1235648483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05cc101de0 0x7f05cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- 172.21.15.18:0/1235648483 >> 172.21.15.18:0/1235648483 conn(0x7f05cc0fd8c0 msgr2=0x7f05cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- 172.21.15.18:0/1235648483 shutdown_connections 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- 172.21.15.18:0/1235648483 wait complete. 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 Processor -- start 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- start start 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05cc101de0 0x7f05cc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05cc102790 0x7f05cc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 0x7f05cc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc111e20 con 0x7f05cc106f10 2024-09-19T08:42:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc111ca0 con 0x7f05cc102790 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.297+0000 7f05d19b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc111fa0 con 0x7f05cc101de0 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 0x7f05cc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 0x7f05cc19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59778/0 (socket says 172.21.15.18:59778) 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 -- 172.21.15.18:0/1681349153 learned_addr learned my addr 172.21.15.18:0/1681349153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05c3fff640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05cc102790 0x7f05cc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05caffd640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05cc101de0 0x7f05cc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 -- 172.21.15.18:0/1681349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05cc101de0 msgr2=0x7f05cc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05cc101de0 0x7f05cc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 -- 172.21.15.18:0/1681349153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05cc102790 msgr2=0x7f05cc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05cc102790 0x7f05cc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 -- 172.21.15.18:0/1681349153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc19d310 con 0x7f05cc106f10 2024-09-19T08:42:38.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05cb7fe640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 0x7f05cc19cc30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f05c400eaa0 tx=0x7f05c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c400cdb0 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc19d600 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05c4005020 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c40116d0 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.298+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc1a4ee0 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.299+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc1021c0 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.301+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f05c40051d0 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.301+0000 7f05d09b7640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05b80a3240 0x7f05b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.302+0000 7f05caffd640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05b80a3240 0x7f05b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.302+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f05c40cf8b0 con 0x7f05cc106f10 2024-09-19T08:42:38.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.302+0000 7f05caffd640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05b80a3240 0x7f05b80a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00bbe0 tx=0x7f05bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:38.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.305+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05c4016030 con 0x7f05cc106f10 2024-09-19T08:42:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.529+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05cc10a150 con 0x7f05cc106f10 2024-09-19T08:42:38.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.529+0000 7f05d09b7640 1 -- 172.21.15.18:0/1681349153 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f05c409c420 con 0x7f05cc106f10 2024-09-19T08:42:38.530 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:38.530 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"btime":"2024-09-19T08:42:38:222195+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:42:38.530 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 4 2024-09-19T08:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.531+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05b80a3240 msgr2=0x7f05b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.531+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05b80a3240 0x7f05b80a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00bbe0 tx=0x7f05bc00b390 comp rx=0 tx=0).stop 2024-09-19T08:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 msgr2=0x7f05cc19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 0x7f05cc19cc30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f05c400eaa0 tx=0x7f05c400ef60 comp rx=0 tx=0).stop 2024-09-19T08:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 shutdown_connections 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05b80a3240 0x7f05b80a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05cc106f10 0x7f05cc19cc30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05cc102790 0x7f05cc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 --2- 172.21.15.18:0/1681349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05cc101de0 0x7f05cc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 >> 172.21.15.18:0/1681349153 conn(0x7f05cc0fd8c0 msgr2=0x7f05cc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 shutdown_connections 2024-09-19T08:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:38.532+0000 7f05d19b9640 1 -- 172.21.15.18:0/1681349153 wait complete. 2024-09-19T08:42:39.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: Deploying daemon mds.d on smithi018 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.18:6834/3031578467,v1:172.21.15.18:6835/3031578467] up:boot 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: fsmap 3 up:standby 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:42:39.016 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:38 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1681349153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:39.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: Deploying daemon mds.d on smithi018 2024-09-19T08:42:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.18:6834/3031578467,v1:172.21.15.18:6835/3031578467] up:boot 2024-09-19T08:42:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: fsmap 3 up:standby 2024-09-19T08:42:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:42:39.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:38 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1681349153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: Deploying daemon mds.d on smithi018 2024-09-19T08:42:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6834/3031578467,v1:172.21.15.18:6835/3031578467] up:boot 2024-09-19T08:42:39.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: fsmap 3 up:standby 2024-09-19T08:42:39.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:42:39.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:38 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1681349153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:39.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:39 smithi018 ceph-mon[30956]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:39 smithi162 ceph-mon[34870]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:39 smithi150 ceph-mon[34610]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:41.194 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 podman[70259]: 2024-09-19 08:42:41.140664026 +0000 UTC m=+0.145186718 container create 7b98b55aeb0c4be9ec556d8ccba087966dba9b3ff8d5e414c90473402d9d8dd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:42:41.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:41.643 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:41.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 podman[70259]: 2024-09-19 08:42:41.368842114 +0000 UTC m=+0.373364828 container init 7b98b55aeb0c4be9ec556d8ccba087966dba9b3ff8d5e414c90473402d9d8dd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T08:42:41.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 podman[70259]: 2024-09-19 08:42:41.372231055 +0000 UTC m=+0.376753748 container start 7b98b55aeb0c4be9ec556d8ccba087966dba9b3ff8d5e414c90473402d9d8dd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T08:42:41.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mds[70279]: -- 172.21.15.18:0/2777188506 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eebdb35860 con 0x55eebdb13000 2024-09-19T08:42:41.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d[70274]: starting mds.d at 2024-09-19T08:42:41.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 bash[70259]: 7b98b55aeb0c4be9ec556d8ccba087966dba9b3ff8d5e414c90473402d9d8dd2 2024-09-19T08:42:41.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:42:41 smithi018 systemd[1]: Started Ceph mds.d for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:42.038 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:41 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:42.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:42.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.064 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:42.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:42.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:41 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 -- 172.21.15.18:0/4192066418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4101400 msgr2=0x7f00d410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 --2- 172.21.15.18:0/4192066418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4101400 0x7f00d410d930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009cd0 tx=0x7f00cc02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 -- 172.21.15.18:0/4192066418 shutdown_connections 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 --2- 172.21.15.18:0/4192066418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4101400 0x7f00d410d930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 --2- 172.21.15.18:0/4192066418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d4100a60 0x7f00d4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 --2- 172.21.15.18:0/4192066418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 0x7f00d4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 -- 172.21.15.18:0/4192066418 >> 172.21.15.18:0/4192066418 conn(0x7f00d40fc780 msgr2=0x7f00d40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 -- 172.21.15.18:0/4192066418 shutdown_connections 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.146+0000 7f00d89f2640 1 -- 172.21.15.18:0/4192066418 wait complete. 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 Processor -- start 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 -- start start 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 0x7f00d4102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d4101400 0x7f00d4102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 0x7f00d41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4110d30 con 0x7f00d4100a60 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4110bb0 con 0x7f00d4106a60 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d89f2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4110eb0 con 0x7f00d4101400 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 0x7f00d4102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 0x7f00d4102630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37380/0 (socket says 172.21.15.18:37380) 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 -- 172.21.15.18:0/314888931 learned_addr learned my addr 172.21.15.18:0/314888931 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d1d9b640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d4101400 0x7f00d4102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d2d9d640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 0x7f00d41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 -- 172.21.15.18:0/314888931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d4101400 msgr2=0x7f00d4102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d4101400 0x7f00d4102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 -- 172.21.15.18:0/314888931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 msgr2=0x7f00d41030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 0x7f00d41030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d259c640 1 -- 172.21.15.18:0/314888931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d41a6890 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.147+0000 7f00d2d9d640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 0x7f00d41030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.148+0000 7f00d259c640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 0x7f00d4102630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00c400d950 tx=0x7f00c400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.148+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4017030 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.148+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00c4004020 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.148+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d41a6b80 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.148+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4005570 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.148+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d41a70c0 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.149+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d4100ec0 con 0x7f00d4100a60 2024-09-19T08:42:42.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.150+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f00c40041d0 con 0x7f00d4100a60 2024-09-19T08:42:42.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.151+0000 7f00c37fe640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00bc0a3240 0x7f00bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.151+0000 7f00d1d9b640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00bc0a3240 0x7f00bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.151+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f00c40cf500 con 0x7f00d4100a60 2024-09-19T08:42:42.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.151+0000 7f00d1d9b640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00bc0a3240 0x7f00bc0a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f00d41040c0 tx=0x7f00c8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:42.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.154+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00c400e350 con 0x7f00d4100a60 2024-09-19T08:42:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.367+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00d4103b60 con 0x7f00d4100a60 2024-09-19T08:42:42.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.367+0000 7f00c37fe640 1 -- 172.21.15.18:0/314888931 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f00c409c620 con 0x7f00d4100a60 2024-09-19T08:42:42.368 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:42.368 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"btime":"2024-09-19T08:42:41:744179+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:42:42.369 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 5 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00bc0a3240 msgr2=0x7f00bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00bc0a3240 0x7f00bc0a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f00d41040c0 tx=0x7f00c8009110 comp rx=0 tx=0).stop 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 msgr2=0x7f00d4102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 0x7f00d4102630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00c400d950 tx=0x7f00c400dd50 comp rx=0 tx=0).stop 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 shutdown_connections 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00bc0a3240 0x7f00bc0a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00d4106a60 0x7f00d41030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d4101400 0x7f00d4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 --2- 172.21.15.18:0/314888931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d4100a60 0x7f00d4102630 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.369+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 >> 172.21.15.18:0/314888931 conn(0x7f00d40fc780 msgr2=0x7f00d4104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:42.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.370+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 shutdown_connections 2024-09-19T08:42:42.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:42.370+0000 7f00d89f2640 1 -- 172.21.15.18:0/314888931 wait complete. 2024-09-19T08:42:43.041 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:42 smithi150 ceph-mon[34610]: Deploying daemon mds.e on smithi150 2024-09-19T08:42:43.041 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:42 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.18:6836/1252489164,v1:172.21.15.18:6837/1252489164] up:boot 2024-09-19T08:42:43.041 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:42 smithi150 ceph-mon[34610]: fsmap 4 up:standby 2024-09-19T08:42:43.041 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:42 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:42:43.041 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/314888931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:43.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:42 smithi018 ceph-mon[30956]: Deploying daemon mds.e on smithi150 2024-09-19T08:42:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:42 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6836/1252489164,v1:172.21.15.18:6837/1252489164] up:boot 2024-09-19T08:42:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:42 smithi018 ceph-mon[30956]: fsmap 4 up:standby 2024-09-19T08:42:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:42:43.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/314888931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:42 smithi162 ceph-mon[34870]: Deploying daemon mds.e on smithi150 2024-09-19T08:42:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:42 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.18:6836/1252489164,v1:172.21.15.18:6837/1252489164] up:boot 2024-09-19T08:42:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:42 smithi162 ceph-mon[34870]: fsmap 4 up:standby 2024-09-19T08:42:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:42 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:42:43.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/314888931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:43.755 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:43 smithi150 systemd[1]: Starting Ceph mds.e for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:43 smithi150 ceph-mon[34610]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:44.065 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:43 smithi150 podman[63964]: 2024-09-19 08:42:43.690065727 +0000 UTC m=+0.016213499 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:44.065 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:43 smithi150 podman[63964]: 2024-09-19 08:42:43.840576686 +0000 UTC m=+0.166724457 container create 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:42:44.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:43 smithi162 ceph-mon[34870]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:44.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:43 smithi018 ceph-mon[30956]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:44.565 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 podman[63964]: 2024-09-19 08:42:44.110497932 +0000 UTC m=+0.436645704 container init 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T08:42:44.565 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 podman[63964]: 2024-09-19 08:42:44.113398143 +0000 UTC m=+0.439545925 container start 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:42:44.565 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 ceph-mds[63983]: -- 172.21.15.150:0/791502280 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555b77f40680 con 0x555b77f15400 2024-09-19T08:42:44.566 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 ceph-mds[63983]: -- 172.21.15.150:0/791502280 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b77f37860 con 0x555b77f15400 2024-09-19T08:42:44.566 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e[63979]: starting mds.e at 2024-09-19T08:42:44.566 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 bash[63964]: 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 2024-09-19T08:42:44.566 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:42:44 smithi150 systemd[1]: Started Ceph mds.e for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:45.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:45.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:45.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:45.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: Deploying daemon mds.f on smithi162 2024-09-19T08:42:45.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.150:6834/1640401494,v1:172.21.15.150:6835/1640401494] up:boot 2024-09-19T08:42:45.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: fsmap 5 up:standby 2024-09-19T08:42:45.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:45 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: Deploying daemon mds.f on smithi162 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.150:6834/1640401494,v1:172.21.15.150:6835/1640401494] up:boot 2024-09-19T08:42:45.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: fsmap 5 up:standby 2024-09-19T08:42:45.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:42:45.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:45.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: Deploying daemon mds.f on smithi162 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.150:6834/1640401494,v1:172.21.15.150:6835/1640401494] up:boot 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: fsmap 5 up:standby 2024-09-19T08:42:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:45 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:42:45.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 -- 172.21.15.18:0/3867707215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 msgr2=0x7fab84103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:45.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 --2- 172.21.15.18:0/3867707215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84103120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab74009900 tx=0x7fab7402a480 comp rx=0 tx=0).stop 2024-09-19T08:42:45.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 -- 172.21.15.18:0/3867707215 shutdown_connections 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 --2- 172.21.15.18:0/3867707215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab8410c170 0x7fab8410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 --2- 172.21.15.18:0/3867707215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab84103660 0x7fab8410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 --2- 172.21.15.18:0/3867707215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84103120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.930+0000 7fab89a18640 1 -- 172.21.15.18:0/3867707215 >> 172.21.15.18:0/3867707215 conn(0x7fab840fc7a0 msgr2=0x7fab840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 -- 172.21.15.18:0/3867707215 shutdown_connections 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 -- 172.21.15.18:0/3867707215 wait complete. 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 Processor -- start 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 -- start start 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab84103660 0x7fab84198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab8410c170 0x7fab8419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab84111e20 con 0x7fab84102d40 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fab84111ca0 con 0x7fab8410c170 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.931+0000 7fab89a18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab84111fa0 con 0x7fab84103660 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37400/0 (socket says 172.21.15.18:37400) 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 -- 172.21.15.18:0/3567953840 learned_addr learned my addr 172.21.15.18:0/3567953840 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab7bfff640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab84103660 0x7fab84198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab837fe640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab8410c170 0x7fab8419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 -- 172.21.15.18:0/3567953840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab84103660 msgr2=0x7fab84198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab84103660 0x7fab84198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 -- 172.21.15.18:0/3567953840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab8410c170 msgr2=0x7fab8419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab8410c170 0x7fab8419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 -- 172.21.15.18:0/3567953840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8419d3b0 con 0x7fab84102d40 2024-09-19T08:42:45.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab82ffd640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84198400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab74005940 tx=0x7fab740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7403f030 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab74003cb0 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8419d640 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74035070 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.932+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab841a4f80 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.933+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8406b070 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.934+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fab74042030 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.935+0000 7fab88a16640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fab700a32c0 0x7fab700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.935+0000 7fab7bfff640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fab700a32c0 0x7fab700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.935+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fab740efb50 con 0x7fab84102d40 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.936+0000 7fab7bfff640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fab700a32c0 0x7fab700a5780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab840fee70 tx=0x7fab6c00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:45.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:45.939+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab740bc6c0 con 0x7fab84102d40 2024-09-19T08:42:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.150+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab84107210 con 0x7fab84102d40 2024-09-19T08:42:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.151+0000 7fab88a16640 1 -- 172.21.15.18:0/3567953840 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fab740c09c0 con 0x7fab84102d40 2024-09-19T08:42:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:46.151 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T08:42:44:756173+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T08:42:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T08:42:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fab700a32c0 msgr2=0x7fab700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fab700a32c0 0x7fab700a5780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab840fee70 tx=0x7fab6c00b2e0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 msgr2=0x7fab84198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84198400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab74005940 tx=0x7fab740042f0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 shutdown_connections 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fab700a32c0 0x7fab700a5780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab8410c170 0x7fab8419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab84103660 0x7fab84198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 --2- 172.21.15.18:0/3567953840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab84102d40 0x7fab84198400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 >> 172.21.15.18:0/3567953840 conn(0x7fab840fc7a0 msgr2=0x7fab840fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 shutdown_connections 2024-09-19T08:42:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:46.153+0000 7fab89a18640 1 -- 172.21.15.18:0/3567953840 wait complete. 2024-09-19T08:42:46.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:46 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3567953840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:46.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:46 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3567953840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:46.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:46 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3567953840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:47.166 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:42:46 smithi162 systemd[1]: Started Ceph mds.f for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:47.540 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:47.540 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.541 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.541 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.541 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:47.541 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:47.541 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:47 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:47.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:47.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:47.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:47.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:47 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:47 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:48.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:48 smithi150 ceph-mon[34610]: Deploying daemon mds.c on smithi162 2024-09-19T08:42:48.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:48 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.162:6834/1358504663,v1:172.21.15.162:6835/1358504663] up:boot 2024-09-19T08:42:48.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:48 smithi150 ceph-mon[34610]: fsmap 6 up:standby 2024-09-19T08:42:48.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:48 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:42:48.607 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:48 smithi162 ceph-mon[34870]: Deploying daemon mds.c on smithi162 2024-09-19T08:42:48.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:48 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.162:6834/1358504663,v1:172.21.15.162:6835/1358504663] up:boot 2024-09-19T08:42:48.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:48 smithi162 ceph-mon[34870]: fsmap 6 up:standby 2024-09-19T08:42:48.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:48 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:42:48.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:48 smithi018 ceph-mon[30956]: Deploying daemon mds.c on smithi162 2024-09-19T08:42:48.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:48 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6834/1358504663,v1:172.21.15.162:6835/1358504663] up:boot 2024-09-19T08:42:48.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:48 smithi018 ceph-mon[30956]: fsmap 6 up:standby 2024-09-19T08:42:48.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:42:48.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:48.917 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:48 smithi162 systemd[1]: Starting Ceph mds.c for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:49.269 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 podman[65030]: 2024-09-19 08:42:48.907754913 +0000 UTC m=+0.016156862 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:49.269 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 podman[65030]: 2024-09-19 08:42:49.014511929 +0000 UTC m=+0.122913871 container create 1235ebeb97429a435acb3d20ebe4c7232213b4befe5d026e94dfb2d3f8a0b761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T08:42:49.269 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 podman[65030]: 2024-09-19 08:42:49.242135077 +0000 UTC m=+0.350537021 container init 1235ebeb97429a435acb3d20ebe4c7232213b4befe5d026e94dfb2d3f8a0b761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T08:42:49.269 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 podman[65030]: 2024-09-19 08:42:49.245306098 +0000 UTC m=+0.353708048 container start 1235ebeb97429a435acb3d20ebe4c7232213b4befe5d026e94dfb2d3f8a0b761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:42:49.269 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 ceph-mds[65049]: -- 172.21.15.162:0/1205861822 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db4ee5d860 con 0x55db4ee3b000 2024-09-19T08:42:49.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:49 smithi018 ceph-mon[30956]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:49.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:49 smithi150 ceph-mon[34610]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.632+0000 7f6d159d8640 1 -- 172.21.15.18:0/3894980962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1010c160 msgr2=0x7f6d1010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.632+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3894980962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1010c160 0x7f6d1010e600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009900 tx=0x7f6d0802a480 comp rx=0 tx=0).stop 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 -- 172.21.15.18:0/3894980962 shutdown_connections 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3894980962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1010c160 0x7f6d1010e600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3894980962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d10103650 0x7f6d1010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3894980962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10102d30 0x7f6d10103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 -- 172.21.15.18:0/3894980962 >> 172.21.15.18:0/3894980962 conn(0x7f6d100fc7d0 msgr2=0x7f6d100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 -- 172.21.15.18:0/3894980962 shutdown_connections 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 -- 172.21.15.18:0/3894980962 wait complete. 2024-09-19T08:42:49.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 Processor -- start 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.633+0000 7f6d159d8640 1 -- start start 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 0x7f6d10100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10103650 0x7f6d10100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d1010c160 0x7f6d10101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10111e50 con 0x7f6d10102d30 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10111cd0 con 0x7f6d1010c160 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10111fd0 con 0x7f6d10103650 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 0x7f6d10100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 0x7f6d10100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33952/0 (socket says 172.21.15.18:33952) 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 -- 172.21.15.18:0/3534425909 learned_addr learned my addr 172.21.15.18:0/3534425909 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0f7fe640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d1010c160 0x7f6d10101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0e7fc640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10103650 0x7f6d10100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 -- 172.21.15.18:0/3534425909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10103650 msgr2=0x7f6d10100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10103650 0x7f6d10100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 -- 172.21.15.18:0/3534425909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d1010c160 msgr2=0x7f6d10101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d1010c160 0x7f6d10101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 -- 172.21.15.18:0/3534425909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d101a6810 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d0effd640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 0x7f6d10100990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000ba50 tx=0x7f6d0000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00019070 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d0000cbe0 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d101a6b00 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.634+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d000075d0 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.635+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d101a7040 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.635+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d10103110 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.637+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6d0001c070 con 0x7f6d10102d30 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.637+0000 7f6d149d6640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6cf80a3240 0x7f6cf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.637+0000 7f6d0e7fc640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6cf80a3240 0x7f6cf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.637+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6d000cea20 con 0x7f6d10102d30 2024-09-19T08:42:49.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.638+0000 7f6d0e7fc640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6cf80a3240 0x7f6cf80a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d04005fd0 tx=0x7f6d04009510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.642+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d0009b590 con 0x7f6d10102d30 2024-09-19T08:42:49.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:49 smithi162 ceph-mon[34870]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:49.667 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c[65045]: starting mds.c at 2024-09-19T08:42:49.667 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 bash[65030]: 1235ebeb97429a435acb3d20ebe4c7232213b4befe5d026e94dfb2d3f8a0b761 2024-09-19T08:42:49.667 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:42:49 smithi162 systemd[1]: Started Ceph mds.c for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:49.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.854+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d10106c70 con 0x7f6d10102d30 2024-09-19T08:42:49.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.855+0000 7f6d149d6640 1 -- 172.21.15.18:0/3534425909 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f6d0009f890 con 0x7f6d10102d30 2024-09-19T08:42:49.854 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:49.854 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-19T08:42:49:277822+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T08:42:49.855 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-19T08:42:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6cf80a3240 msgr2=0x7f6cf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6cf80a3240 0x7f6cf80a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d04005fd0 tx=0x7f6d04009510 comp rx=0 tx=0).stop 2024-09-19T08:42:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 msgr2=0x7f6d10100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 0x7f6d10100990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000ba50 tx=0x7f6d0000bf10 comp rx=0 tx=0).stop 2024-09-19T08:42:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 shutdown_connections 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6cf80a3240 0x7f6cf80a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d1010c160 0x7f6d10101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10103650 0x7f6d10100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 --2- 172.21.15.18:0/3534425909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d10102d30 0x7f6d10100990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 >> 172.21.15.18:0/3534425909 conn(0x7f6d100fc7d0 msgr2=0x7f6d100fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 shutdown_connections 2024-09-19T08:42:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:49.857+0000 7f6d159d8640 1 -- 172.21.15.18:0/3534425909 wait complete. 2024-09-19T08:42:50.542 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6836/1673736913,v1:172.21.15.162:6837/1673736913] up:boot 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: fsmap 7 up:standby 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: Deploying daemon mds.h on smithi150 2024-09-19T08:42:50.543 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3534425909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:50.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.162:6836/1673736913,v1:172.21.15.162:6837/1673736913] up:boot 2024-09-19T08:42:50.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: fsmap 7 up:standby 2024-09-19T08:42:50.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: Deploying daemon mds.h on smithi150 2024-09-19T08:42:50.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:50 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3534425909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.162:6836/1673736913,v1:172.21.15.162:6837/1673736913] up:boot 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: fsmap 7 up:standby 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:50.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:50.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: Deploying daemon mds.h on smithi150 2024-09-19T08:42:50.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:50 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3534425909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:51.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:51 smithi150 ceph-mon[34610]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:51.565 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 systemd[1]: Starting Ceph mds.h for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:51.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:51 smithi162 ceph-mon[34870]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:51.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:51 smithi018 ceph-mon[30956]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:51.940 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 podman[64265]: 2024-09-19 08:42:51.571876143 +0000 UTC m=+0.016171185 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:51.940 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 podman[64265]: 2024-09-19 08:42:51.680047945 +0000 UTC m=+0.124342982 container create 74d2786b59f0a290b605bfc8da254265add7b6f6888889de9ec4580643300d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T08:42:52.315 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 podman[64265]: 2024-09-19 08:42:51.941164733 +0000 UTC m=+0.385459774 container init 74d2786b59f0a290b605bfc8da254265add7b6f6888889de9ec4580643300d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T08:42:52.316 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 podman[64265]: 2024-09-19 08:42:51.943901937 +0000 UTC m=+0.388196977 container start 74d2786b59f0a290b605bfc8da254265add7b6f6888889de9ec4580643300d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:42:52.316 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 ceph-mds[64284]: -- 172.21.15.150:0/2436093237 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6ce6b5860 con 0x55e6ce693400 2024-09-19T08:42:52.316 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:51 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h[64280]: starting mds.h at 2024-09-19T08:42:52.316 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:52 smithi150 bash[64265]: 74d2786b59f0a290b605bfc8da254265add7b6f6888889de9ec4580643300d46 2024-09-19T08:42:52.316 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:42:52 smithi150 systemd[1]: Started Ceph mds.h for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:52.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:53.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:53.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: Deploying daemon mds.i on smithi162 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.150:6836/4142212267,v1:172.21.15.150:6837/4142212267] up:boot 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: fsmap 8 up:standby 2024-09-19T08:42:53.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:42:53.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 -- 172.21.15.18:0/1911330709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 msgr2=0x7f91d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 --2- 172.21.15.18:0/1911330709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01029b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009900 tx=0x7f91c402a480 comp rx=0 tx=0).stop 2024-09-19T08:42:53.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 -- 172.21.15.18:0/1911330709 shutdown_connections 2024-09-19T08:42:53.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 --2- 172.21.15.18:0/1911330709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d0102ef0 0x7f91d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 --2- 172.21.15.18:0/1911330709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01029b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 --2- 172.21.15.18:0/1911330709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d0100e20 0x7f91d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 -- 172.21.15.18:0/1911330709 >> 172.21.15.18:0/1911330709 conn(0x7f91d00fc7d0 msgr2=0x7f91d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 -- 172.21.15.18:0/1911330709 shutdown_connections 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.317+0000 7f91d6573640 1 -- 172.21.15.18:0/1911330709 wait complete. 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 Processor -- start 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 -- start start 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d0100e20 0x7f91d0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d0102ef0 0x7f91d01a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0110e30 con 0x7f91d0102570 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0110cb0 con 0x7f91d0100e20 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.318+0000 7f91d6573640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0110fb0 con 0x7f91d0102ef0 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33966/0 (socket says 172.21.15.18:33966) 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 -- 172.21.15.18:0/3616353127 learned_addr learned my addr 172.21.15.18:0/3616353127 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91d4b10640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d0102ef0 0x7f91d01a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cffff640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d0100e20 0x7f91d0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 -- 172.21.15.18:0/3616353127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d0102ef0 msgr2=0x7f91d01a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d0102ef0 0x7f91d01a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 -- 172.21.15.18:0/3616353127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d0100e20 msgr2=0x7f91d0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d0100e20 0x7f91d0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 -- 172.21.15.18:0/3616353127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d01a4840 con 0x7f91d0102570 2024-09-19T08:42:53.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cf7fe640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01997c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91c4006010 tx=0x7f91c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c403f030 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d01a4a10 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91c4003aa0 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4035070 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.319+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d01a4ec0 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.320+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d0101200 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.322+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f91c4042030 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.322+0000 7f91cd7fa640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f91b80a3240 0x7f91b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.322+0000 7f91cffff640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f91b80a3240 0x7f91b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.322+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f91c40efd50 con 0x7f91d0102570 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.323+0000 7f91cffff640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f91b80a3240 0x7f91b80a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009b60 tx=0x7f91c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:53.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.326+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91c40bcf10 con 0x7f91d0102570 2024-09-19T08:42:53.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:53.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:53.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:53.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:53.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: Deploying daemon mds.i on smithi162 2024-09-19T08:42:53.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.150:6836/4142212267,v1:172.21.15.150:6837/4142212267] up:boot 2024-09-19T08:42:53.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: fsmap 8 up:standby 2024-09-19T08:42:53.419 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:53 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:42:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.536+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91d0109090 con 0x7f91d0102570 2024-09-19T08:42:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.537+0000 7f91cd7fa640 1 -- 172.21.15.18:0/3616353127 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f91c40bc810 con 0x7f91d0102570 2024-09-19T08:42:53.537 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:53.537 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"btime":"2024-09-19T08:42:52:397759+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T08:42:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-09-19T08:42:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f91b80a3240 msgr2=0x7f91b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f91b80a3240 0x7f91b80a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009b60 tx=0x7f91c0005f90 comp rx=0 tx=0).stop 2024-09-19T08:42:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 msgr2=0x7f91d01997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01997c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91c4006010 tx=0x7f91c4004270 comp rx=0 tx=0).stop 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 shutdown_connections 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f91b80a3240 0x7f91b80a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d0102ef0 0x7f91d01a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d0102570 0x7f91d01997c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 --2- 172.21.15.18:0/3616353127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d0100e20 0x7f91d0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 >> 172.21.15.18:0/3616353127 conn(0x7f91d00fc7d0 msgr2=0x7f91d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 shutdown_connections 2024-09-19T08:42:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:53.539+0000 7f91d6573640 1 -- 172.21.15.18:0/3616353127 wait complete. 2024-09-19T08:42:53.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:53.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: Deploying daemon mds.i on smithi162 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.150:6836/4142212267,v1:172.21.15.150:6837/4142212267] up:boot 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: fsmap 8 up:standby 2024-09-19T08:42:53.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:53 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:42:54.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:54 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3616353127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:54.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:54 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3616353127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:54.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:54 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3616353127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:54.917 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:42:54 smithi162 systemd[1]: Started Ceph mds.i for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: Deploying daemon mds.g on smithi018 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6838/1612914765,v1:172.21.15.162:6839/1612914765] up:boot 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: fsmap 9 up:standby 2024-09-19T08:42:55.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:42:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: Deploying daemon mds.g on smithi018 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.162:6838/1612914765,v1:172.21.15.162:6839/1612914765] up:boot 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: fsmap 9 up:standby 2024-09-19T08:42:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:55 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:56.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:56.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: Deploying daemon mds.g on smithi018 2024-09-19T08:42:56.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.162:6838/1612914765,v1:172.21.15.162:6839/1612914765] up:boot 2024-09-19T08:42:56.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: fsmap 9 up:standby 2024-09-19T08:42:56.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:55 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:42:56.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:56.547 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 -- 172.21.15.18:0/2511741308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84100e20 msgr2=0x7fcd84101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/2511741308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84100e20 0x7fcd84101200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009900 tx=0x7fcd7402a480 comp rx=0 tx=0).stop 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 -- 172.21.15.18:0/2511741308 shutdown_connections 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/2511741308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd84102ef0 0x7fcd8410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/2511741308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd84102570 0x7fcd841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/2511741308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84100e20 0x7fcd84101200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 -- 172.21.15.18:0/2511741308 >> 172.21.15.18:0/2511741308 conn(0x7fcd840fc7d0 msgr2=0x7fcd840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 -- 172.21.15.18:0/2511741308 shutdown_connections 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 -- 172.21.15.18:0/2511741308 wait complete. 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.054+0000 7fcd8aab4640 1 Processor -- start 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 -- start start 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd84100e20 0x7fcd84198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 0x7fcd841989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd84102ef0 0x7fcd8419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84110e80 con 0x7fcd84102570 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84110d00 con 0x7fcd84100e20 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd8aab4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84111000 con 0x7fcd84102ef0 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 0x7fcd841989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 0x7fcd841989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33982/0 (socket says 172.21.15.18:33982) 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 -- 172.21.15.18:0/1553574881 learned_addr learned my addr 172.21.15.18:0/1553574881 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd89051640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd84102ef0 0x7fcd8419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd88850640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd84100e20 0x7fcd84198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 -- 172.21.15.18:0/1553574881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd84102ef0 msgr2=0x7fcd8419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd84102ef0 0x7fcd8419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 -- 172.21.15.18:0/1553574881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd84100e20 msgr2=0x7fcd84198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd84100e20 0x7fcd84198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 -- 172.21.15.18:0/1553574881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8419d410 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.055+0000 7fcd83fff640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 0x7fcd841989a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00d770 tx=0x7fcd6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.056+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c017070 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.056+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8419d700 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.056+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd6c0054d0 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.056+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c004cf0 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.056+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd841a4fe0 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.057+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd84101200 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.058+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcd6c004e90 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.058+0000 7fcd81ffb640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcd700a3240 0x7fcd700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.059+0000 7fcd88850640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcd700a3240 0x7fcd700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.059+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fcd6c0ceee0 con 0x7fcd84102570 2024-09-19T08:42:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.059+0000 7fcd88850640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcd700a3240 0x7fcd700a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcd74000c00 tx=0x7fcd74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:57.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.063+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd6c09c0a0 con 0x7fcd84102570 2024-09-19T08:42:57.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.280+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd841a51b0 con 0x7fcd84102570 2024-09-19T08:42:57.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.281+0000 7fcd81ffb640 1 -- 172.21.15.18:0/1553574881 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7fcd6c09b9a0 con 0x7fcd84102570 2024-09-19T08:42:57.281 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:42:57.281 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"btime":"2024-09-19T08:42:55:095801+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:42:57.281 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 10 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcd700a3240 msgr2=0x7fcd700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcd700a3240 0x7fcd700a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcd74000c00 tx=0x7fcd74005a20 comp rx=0 tx=0).stop 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 msgr2=0x7fcd841989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 0x7fcd841989a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00d770 tx=0x7fcd6c00dc30 comp rx=0 tx=0).stop 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 shutdown_connections 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcd700a3240 0x7fcd700a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd84102ef0 0x7fcd8419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd84102570 0x7fcd841989a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 --2- 172.21.15.18:0/1553574881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd84100e20 0x7fcd84198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 >> 172.21.15.18:0/1553574881 conn(0x7fcd840fc7d0 msgr2=0x7fcd8406a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:57.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 shutdown_connections 2024-09-19T08:42:57.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:42:57.283+0000 7fcd8aab4640 1 -- 172.21.15.18:0/1553574881 wait complete. 2024-09-19T08:42:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:57 smithi150 ceph-mon[34610]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:58.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:57 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1553574881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:58.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:57 smithi018 ceph-mon[30956]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:58.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1553574881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:58.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:57 smithi162 ceph-mon[34870]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:58.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:57 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1553574881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:58.430 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:42:58 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g[71143]: starting mds.g at 2024-09-19T08:42:58.693 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:42:58 smithi018 bash[71116]: 4bb638834fd6dac040d120e6a5c949eb462f94c48ef51697cc7d140b8eb84f8d 2024-09-19T08:42:58.694 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:42:58 smithi018 systemd[1]: Started Ceph mds.g for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:59.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:59.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: Deploying daemon mds.a on smithi018 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.18:6838/2535601572,v1:172.21.15.18:6839/2535601572] up:boot 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: fsmap 10 up:standby 2024-09-19T08:42:59.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:42:59 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: Deploying daemon mds.a on smithi018 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.18:6838/2535601572,v1:172.21.15.18:6839/2535601572] up:boot 2024-09-19T08:42:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: fsmap 10 up:standby 2024-09-19T08:42:59.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:42:59 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: Deploying daemon mds.a on smithi018 2024-09-19T08:42:59.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6838/2535601572,v1:172.21.15.18:6839/2535601572] up:boot 2024-09-19T08:42:59.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: fsmap 10 up:standby 2024-09-19T08:42:59.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:42:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:43:00.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:00.483 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:01.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.995+0000 7fe300d8c640 1 -- 172.21.15.18:0/903274803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc1008d0 msgr2=0x7fe2fc100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.995+0000 7fe300d8c640 1 --2- 172.21.15.18:0/903274803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc100cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009900 tx=0x7fe2ec02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.995+0000 7fe300d8c640 1 -- 172.21.15.18:0/903274803 shutdown_connections 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.995+0000 7fe300d8c640 1 --2- 172.21.15.18:0/903274803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc10e480 0x7fe2fc110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.995+0000 7fe300d8c640 1 --2- 172.21.15.18:0/903274803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2fc101280 0x7fe2fc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.995+0000 7fe300d8c640 1 --2- 172.21.15.18:0/903274803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc100cb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.996+0000 7fe300d8c640 1 -- 172.21.15.18:0/903274803 >> 172.21.15.18:0/903274803 conn(0x7fe2fc0fc7a0 msgr2=0x7fe2fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.996+0000 7fe300d8c640 1 -- 172.21.15.18:0/903274803 shutdown_connections 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.996+0000 7fe300d8c640 1 -- 172.21.15.18:0/903274803 wait complete. 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.996+0000 7fe300d8c640 1 Processor -- start 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.996+0000 7fe300d8c640 1 -- start start 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe300d8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe300d8c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2fc101280 0x7fe2fc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe300d8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc10e480 0x7fe2fc19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe300d8c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc114040 con 0x7fe2fc10e480 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe300d8c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc113ec0 con 0x7fe2fc101280 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe300d8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc1141c0 con 0x7fe2fc1008d0 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc10e480 0x7fe2fc19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc10e480 0x7fe2fc19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38770/0 (socket says 172.21.15.18:38770) 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2f3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2fc101280 0x7fe2fc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fad9d640 1 -- 172.21.15.18:0/2233940326 learned_addr learned my addr 172.21.15.18:0/2233940326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46028/0 (socket says 172.21.15.18:46028) 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 -- 172.21.15.18:0/2233940326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2fc101280 msgr2=0x7fe2fc19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2fc101280 0x7fe2fc19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 -- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc10e480 msgr2=0x7fe2fc19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc10e480 0x7fe2fc19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 -- 172.21.15.18:0/2233940326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc19f550 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.997+0000 7fe2fa59c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc19a5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec02a930 tx=0x7fe2ec031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.998+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec03f030 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.998+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2ec004490 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.998+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2fc19f7e0 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.998+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec035070 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.998+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2fc1a7120 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:00.999+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2fc06b070 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.000+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe2ec042030 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.000+0000 7fe2f37fe640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2e80a3240 0x7fe2e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.001+0000 7fe2f3fff640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2e80a3240 0x7fe2e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.001+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe2ec0ef930 con 0x7fe2fc1008d0 2024-09-19T08:43:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.001+0000 7fe2f3fff640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2e80a3240 0x7fe2e80a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc10e930 tx=0x7fe2e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:01.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.003+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2ec0bc400 con 0x7fe2fc1008d0 2024-09-19T08:43:01.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.219+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2fc100cb0 con 0x7fe2fc1008d0 2024-09-19T08:43:01.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.220+0000 7fe2f37fe640 1 -- 172.21.15.18:0/2233940326 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fe2fc100cb0 con 0x7fe2fc1008d0 2024-09-19T08:43:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:01.220 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":11,"btime":"2024-09-19T08:42:58:706243+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:43:01.220 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 11 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2e80a3240 msgr2=0x7fe2e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2e80a3240 0x7fe2e80a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc10e930 tx=0x7fe2e4005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 msgr2=0x7fe2fc19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc19a5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec02a930 tx=0x7fe2ec031a20 comp rx=0 tx=0).stop 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 shutdown_connections 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2e80a3240 0x7fe2e80a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2fc10e480 0x7fe2fc19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2fc101280 0x7fe2fc19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 --2- 172.21.15.18:0/2233940326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2fc1008d0 0x7fe2fc19a5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.222+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 >> 172.21.15.18:0/2233940326 conn(0x7fe2fc0fc7a0 msgr2=0x7fe2fc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:01.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.223+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 shutdown_connections 2024-09-19T08:43:01.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:01.223+0000 7fe300d8c640 1 -- 172.21.15.18:0/2233940326 wait complete. 2024-09-19T08:43:01.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:01 smithi018 ceph-mon[30956]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:01.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:01 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2233940326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:01.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:01 smithi150 ceph-mon[34610]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:01.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:01 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2233940326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:01 smithi162 ceph-mon[34870]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:01 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2233940326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:01.937 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:43:01 smithi018 systemd[1]: Started Ceph mds.a for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:43:03.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: Deploying daemon mds.b on smithi150 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.18:6840/2703044208,v1:172.21.15.18:6841/2703044208] up:boot 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: fsmap 11 up:standby 2024-09-19T08:43:03.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:02 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: Deploying daemon mds.b on smithi150 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.18:6840/2703044208,v1:172.21.15.18:6841/2703044208] up:boot 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: fsmap 11 up:standby 2024-09-19T08:43:03.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:02 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:03.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: Deploying daemon mds.b on smithi150 2024-09-19T08:43:03.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:03.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6840/2703044208,v1:172.21.15.18:6841/2703044208] up:boot 2024-09-19T08:43:03.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: fsmap 11 up:standby 2024-09-19T08:43:03.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:43:03.983 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:03 smithi150 systemd[1]: Starting Ceph mds.b for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:43:04.233 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:03 smithi150 podman[64580]: 2024-09-19 08:43:03.885787196 +0000 UTC m=+0.015591237 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:43:04.233 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:03 smithi150 podman[64580]: 2024-09-19 08:43:03.995154453 +0000 UTC m=+0.124958527 container create 5ac16a95de5c224e21f85df7575b7972a43d2709a7b5b2da2cbd0dd62a95644d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T08:43:04.233 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:04 smithi150 podman[64580]: 2024-09-19 08:43:04.23140435 +0000 UTC m=+0.361208383 container init 5ac16a95de5c224e21f85df7575b7972a43d2709a7b5b2da2cbd0dd62a95644d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-19T08:43:04.233 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:04 smithi150 podman[64580]: 2024-09-19 08:43:04.234304258 +0000 UTC m=+0.364108287 container start 5ac16a95de5c224e21f85df7575b7972a43d2709a7b5b2da2cbd0dd62a95644d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:43:04.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:04.565 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:04 smithi150 ceph-mds[64599]: -- 172.21.15.150:0/2918089128 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db7afc5860 con 0x55db7afa3400 2024-09-19T08:43:04.565 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: starting mds.b at 2024-09-19T08:43:04.565 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:04 smithi150 bash[64580]: 5ac16a95de5c224e21f85df7575b7972a43d2709a7b5b2da2cbd0dd62a95644d 2024-09-19T08:43:04.565 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:04 smithi150 systemd[1]: Started Ceph mds.b for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:43:04.575 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:05.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 -- 172.21.15.18:0/2025082593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90100e20 msgr2=0x7f7d90101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 --2- 172.21.15.18:0/2025082593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90100e20 0x7f7d90101200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009900 tx=0x7f7d8002a480 comp rx=0 tx=0).stop 2024-09-19T08:43:05.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 -- 172.21.15.18:0/2025082593 shutdown_connections 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 --2- 172.21.15.18:0/2025082593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d90102ef0 0x7f7d9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 --2- 172.21.15.18:0/2025082593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90102570 0x7f7d901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 --2- 172.21.15.18:0/2025082593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90100e20 0x7f7d90101200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.070+0000 7f7d96437640 1 -- 172.21.15.18:0/2025082593 >> 172.21.15.18:0/2025082593 conn(0x7f7d900fc7d0 msgr2=0x7f7d900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.071+0000 7f7d96437640 1 -- 172.21.15.18:0/2025082593 shutdown_connections 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.071+0000 7f7d96437640 1 -- 172.21.15.18:0/2025082593 wait complete. 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.072+0000 7f7d96437640 1 Processor -- start 2024-09-19T08:43:05.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.072+0000 7f7d96437640 1 -- start start 2024-09-19T08:43:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.072+0000 7f7d96437640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 0x7f7d901972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.072+0000 7f7d96437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90102570 0x7f7d90197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.072+0000 7f7d96437640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d90102ef0 0x7f7d9019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.072+0000 7f7d96437640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90110e30 con 0x7f7d90102570 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d96437640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90110cb0 con 0x7f7d90102ef0 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d96437640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90110fb0 con 0x7f7d90100e20 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 0x7f7d901972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90102570 0x7f7d90197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 0x7f7d901972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46062/0 (socket says 172.21.15.18:46062) 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 -- 172.21.15.18:0/1383210755 learned_addr learned my addr 172.21.15.18:0/1383210755 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 -- 172.21.15.18:0/1383210755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d90102ef0 msgr2=0x7f7d9019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d90102ef0 0x7f7d9019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 -- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90102570 msgr2=0x7f7d90197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90102570 0x7f7d90197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 -- 172.21.15.18:0/1383210755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9019c280 con 0x7f7d90100e20 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8f7fe640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90102570 0x7f7d90197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8ffff640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 0x7f7d901972d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d80006010 tx=0x7f7d80004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.073+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8003f030 con 0x7f7d90100e20 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.074+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d80003aa0 con 0x7f7d90100e20 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.074+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9019c510 con 0x7f7d90100e20 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.074+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80035070 con 0x7f7d90100e20 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.074+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d90069f70 con 0x7f7d90100e20 2024-09-19T08:43:05.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.075+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d901021b0 con 0x7f7d90100e20 2024-09-19T08:43:05.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.076+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7d80042030 con 0x7f7d90100e20 2024-09-19T08:43:05.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.077+0000 7f7d8d7fa640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7d780a32c0 0x7f7d780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.077+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f7d800efdb0 con 0x7f7d90100e20 2024-09-19T08:43:05.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.077+0000 7f7d8f7fe640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7d780a32c0 0x7f7d780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.077+0000 7f7d8f7fe640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7d780a32c0 0x7f7d780a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d901036c0 tx=0x7f7d8400f7a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:05.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.080+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d800bced0 con 0x7f7d90100e20 2024-09-19T08:43:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.302+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d9006a990 con 0x7f7d90100e20 2024-09-19T08:43:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.303+0000 7f7d8d7fa640 1 -- 172.21.15.18:0/1383210755 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f7d800bc7d0 con 0x7f7d90100e20 2024-09-19T08:43:05.302 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:05.302 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T08:43:04:894603+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T08:43:05.303 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7d780a32c0 msgr2=0x7f7d780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7d780a32c0 0x7f7d780a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d901036c0 tx=0x7f7d8400f7a0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 msgr2=0x7f7d901972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 0x7f7d901972d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d80006010 tx=0x7f7d80004270 comp rx=0 tx=0).stop 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 shutdown_connections 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7d780a32c0 0x7f7d780a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d90102ef0 0x7f7d9019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d90102570 0x7f7d90197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 --2- 172.21.15.18:0/1383210755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d90100e20 0x7f7d901972d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 >> 172.21.15.18:0/1383210755 conn(0x7f7d900fc7d0 msgr2=0x7f7d900fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 shutdown_connections 2024-09-19T08:43:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:05.305+0000 7f7d96437640 1 -- 172.21.15.18:0/1383210755 wait complete. 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] up:boot 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: fsmap 12 up:standby 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:43:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:05 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1383210755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:05.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:05.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] up:boot 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: fsmap 12 up:standby 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:43:05.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:05 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1383210755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] up:boot 2024-09-19T08:43:05.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: fsmap 12 up:standby 2024-09-19T08:43:05.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:43:05.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:05 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1383210755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:06.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T08:43:06.867 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:07.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:07.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:07.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:07.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:07.316 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:06 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 -- 172.21.15.18:0/1108856817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238106f10 msgr2=0x7f723810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 --2- 172.21.15.18:0/1108856817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238106f10 0x7f723810ea90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7230009ca0 tx=0x7f723002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 -- 172.21.15.18:0/1108856817 shutdown_connections 2024-09-19T08:43:07.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 --2- 172.21.15.18:0/1108856817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238106f10 0x7f723810ea90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 --2- 172.21.15.18:0/1108856817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7238102790 0x7f72381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 --2- 172.21.15.18:0/1108856817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7238101de0 0x7f72381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 -- 172.21.15.18:0/1108856817 >> 172.21.15.18:0/1108856817 conn(0x7f72380fd8c0 msgr2=0x7f72380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 -- 172.21.15.18:0/1108856817 shutdown_connections 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.333+0000 7f723f3ed640 1 -- 172.21.15.18:0/1108856817 wait complete. 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 Processor -- start 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 -- start start 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 0x7f72380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7238102790 0x7f7238074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7238106f10 0x7f7238074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7238111e20 con 0x7f7238101de0 2024-09-19T08:43:07.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7238111ca0 con 0x7f7238102790 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723f3ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7238111fa0 con 0x7f7238106f10 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 0x7f72380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 0x7f72380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38836/0 (socket says 172.21.15.18:38836) 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 -- 172.21.15.18:0/2455355853 learned_addr learned my addr 172.21.15.18:0/2455355853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723c988640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7238102790 0x7f7238074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d98a640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7238106f10 0x7f7238074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 -- 172.21.15.18:0/2455355853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7238106f10 msgr2=0x7f7238074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7238106f10 0x7f7238074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 -- 172.21.15.18:0/2455355853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7238102790 msgr2=0x7f7238074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7238102790 0x7f7238074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.334+0000 7f723d189640 1 -- 172.21.15.18:0/2455355853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72381a67d0 con 0x7f7238101de0 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.335+0000 7f723d189640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 0x7f72380744f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f723400d950 tx=0x7f723400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:07.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.335+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234017030 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.335+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72381a6ac0 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.335+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72381a7050 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.335+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7234004020 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.335+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340047a0 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.336+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c005290 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.337+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f72340041d0 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.338+0000 7f722e7fc640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f72240a32c0 0x7f72240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.338+0000 7f723c988640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f72240a32c0 0x7f72240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.338+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f72340cf370 con 0x7f7238101de0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.338+0000 7f723c988640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f72240a32c0 0x7f72240a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7238075f80 tx=0x7f722800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.341+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f723409c5b0 con 0x7f7238101de0 2024-09-19T08:43:07.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:06 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:07.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.527+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f721c005850 con 0x7f7238101de0 2024-09-19T08:43:07.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.528+0000 7f722e7fc640 1 -- 172.21.15.18:0/2455355853 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f723409beb0 con 0x7f7238101de0 2024-09-19T08:43:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:07.527 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T08:43:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:43:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T08:43:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T08:43:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:43:07.528 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T08:43:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f72240a32c0 msgr2=0x7f72240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f72240a32c0 0x7f72240a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7238075f80 tx=0x7f722800b410 comp rx=0 tx=0).stop 2024-09-19T08:43:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 msgr2=0x7f72380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 0x7f72380744f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f723400d950 tx=0x7f723400de10 comp rx=0 tx=0).stop 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 shutdown_connections 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f72240a32c0 0x7f72240a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7238106f10 0x7f7238074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7238102790 0x7f7238074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 --2- 172.21.15.18:0/2455355853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238101de0 0x7f72380744f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 >> 172.21.15.18:0/2455355853 conn(0x7f72380fd8c0 msgr2=0x7f72380fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 shutdown_connections 2024-09-19T08:43:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:07.530+0000 7f723f3ed640 1 -- 172.21.15.18:0/2455355853 wait complete. 2024-09-19T08:43:08.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:08.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:07 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2455355853' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:43:08.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:08.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:08.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:07 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2455355853' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:43:08.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:07 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:08.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:08.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:07 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2455355853' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:43:08.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:07 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:08.966 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:43:08.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:43:09.272 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:09.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 -- 172.21.15.18:0/3609952606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 msgr2=0x7f350c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 --2- 172.21.15.18:0/3609952606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c1021c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3504009900 tx=0x7f350402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 -- 172.21.15.18:0/3609952606 shutdown_connections 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 --2- 172.21.15.18:0/3609952606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c106f10 0x7f350c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 --2- 172.21.15.18:0/3609952606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c102790 0x7f350c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 --2- 172.21.15.18:0/3609952606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c1021c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 -- 172.21.15.18:0/3609952606 >> 172.21.15.18:0/3609952606 conn(0x7f350c0fd8c0 msgr2=0x7f350c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 -- 172.21.15.18:0/3609952606 shutdown_connections 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 -- 172.21.15.18:0/3609952606 wait complete. 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 Processor -- start 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 -- start start 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.802+0000 7f3512aa1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3512aa1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102790 0x7f350c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3512aa1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c106f10 0x7f350c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3512aa1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111e40 con 0x7f350c101de0 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3512aa1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111cc0 con 0x7f350c106f10 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3512aa1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111fc0 con 0x7f350c102790 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54902/0 (socket says 172.21.15.18:54902) 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 -- 172.21.15.18:0/1403963166 learned_addr learned my addr 172.21.15.18:0/1403963166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f350bfff640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102790 0x7f350c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351103e640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c106f10 0x7f350c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 -- 172.21.15.18:0/1403963166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102790 msgr2=0x7f350c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102790 0x7f350c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 -- 172.21.15.18:0/1403963166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c106f10 msgr2=0x7f350c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c106f10 0x7f350c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 -- 172.21.15.18:0/1403963166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c19d3b0 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f350bfff640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102790 0x7f350c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351103e640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c106f10 0x7f350c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f351083d640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c198400 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3504006010 tx=0x7f3504004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350403f030 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c19d640 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35040035f0 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.803+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504035070 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.804+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c1a4f80 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.805+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c1032c0 con 0x7f350c101de0 2024-09-19T08:43:09.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.806+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3504003b10 con 0x7f350c101de0 2024-09-19T08:43:09.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.807+0000 7f3509ffb640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34f80a3240 0x7f34f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.807+0000 7f350bfff640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34f80a3240 0x7f34f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.807+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f35040f00a0 con 0x7f350c101de0 2024-09-19T08:43:09.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.807+0000 7f350bfff640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34f80a3240 0x7f34f80a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f350c0ffeb0 tx=0x7f34fc0073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:09.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.811+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35040bd260 con 0x7f350c101de0 2024-09-19T08:43:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:09.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:09.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:09.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:43:09.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:09.989+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f350c10a0f0 con 0x7f350c101de0 2024-09-19T08:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.445+0000 7f3509ffb640 1 -- 172.21.15.18:0/1403963166 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f35040bcb60 con 0x7f350c101de0 2024-09-19T08:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T08:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34f80a3240 msgr2=0x7f34f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34f80a3240 0x7f34f80a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f350c0ffeb0 tx=0x7f34fc0073c0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 msgr2=0x7f350c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c198400 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3504006010 tx=0x7f3504004270 comp rx=0 tx=0).stop 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 shutdown_connections 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34f80a3240 0x7f34f80a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350c106f10 0x7f350c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102790 0x7f350c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 --2- 172.21.15.18:0/1403963166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f350c101de0 0x7f350c198400 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 >> 172.21.15.18:0/1403963166 conn(0x7f350c0fd8c0 msgr2=0x7f350c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 shutdown_connections 2024-09-19T08:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:10.448+0000 7f3512aa1640 1 -- 172.21.15.18:0/1403963166 wait complete. 2024-09-19T08:43:10.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1403963166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:43:10.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:10 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1403963166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:43:10.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:10 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1403963166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:43:11.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T08:43:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:11.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:11 smithi162 ceph-mon[34870]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:11.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:11 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1403963166' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:43:11.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:11 smithi162 ceph-mon[34870]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:43:11.773 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:11 smithi018 ceph-mon[30956]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:11.773 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:11 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1403963166' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:43:11.773 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:11 smithi018 ceph-mon[30956]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:43:11.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:11 smithi150 ceph-mon[34610]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:11.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:11 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1403963166' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:43:11.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:11 smithi150 ceph-mon[34610]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:43:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 -- 172.21.15.18:0/1973633445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8101df0 msgr2=0x7fe1b81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/1973633445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8101df0 0x7fe1b81021d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009900 tx=0x7fe1a802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 -- 172.21.15.18:0/1973633445 shutdown_connections 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/1973633445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1b8106f20 0x7fe1b810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/1973633445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b81027a0 0x7fe1b81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/1973633445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8101df0 0x7fe1b81021d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 -- 172.21.15.18:0/1973633445 >> 172.21.15.18:0/1973633445 conn(0x7fe1b80fd8f0 msgr2=0x7fe1b80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 -- 172.21.15.18:0/1973633445 shutdown_connections 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.864+0000 7fe1bedb9640 1 -- 172.21.15.18:0/1973633445 wait complete. 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 Processor -- start 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 -- start start 2024-09-19T08:43:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b8101df0 0x7fe1b8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1b81027a0 0x7fe1b81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 0x7fe1b819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111e30 con 0x7fe1b8106f20 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111cb0 con 0x7fe1b81027a0 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.865+0000 7fe1bedb9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111fb0 con 0x7fe1b8101df0 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 0x7fe1b819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 0x7fe1b819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54932/0 (socket says 172.21.15.18:54932) 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 -- 172.21.15.18:0/3897427568 learned_addr learned my addr 172.21.15.18:0/3897427568 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1b7fff640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1b81027a0 0x7fe1b81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bcb55640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b8101df0 0x7fe1b8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 -- 172.21.15.18:0/3897427568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b8101df0 msgr2=0x7fe1b8198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b8101df0 0x7fe1b8198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 -- 172.21.15.18:0/3897427568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1b81027a0 msgr2=0x7fe1b81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1b81027a0 0x7fe1b81987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 -- 172.21.15.18:0/3897427568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b819d240 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bd356640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 0x7fe1b819cb60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000cce0 tx=0x7fe1b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000f450 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1b000faa0 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b819d530 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.866+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0018b70 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.867+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b81a4e10 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.867+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b81021d0 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.869+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe1b0018d10 con 0x7fe1b8106f20 2024-09-19T08:43:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.869+0000 7fe1b5ffb640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe1a00a3240 0x7fe1a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.869+0000 7fe1bcb55640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe1a00a3240 0x7fe1a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.869+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fe1b00cf900 con 0x7fe1b8106f20 2024-09-19T08:43:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.870+0000 7fe1bcb55640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe1a00a3240 0x7fe1a00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8031440 tx=0x7fe1a8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:11.873+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe1b0014030 con 0x7fe1b8106f20 2024-09-19T08:43:12.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.050+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fe1b802d7c0 con 0x7fe1b8106f20 2024-09-19T08:43:12.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.485+0000 7fe1b5ffb640 1 -- 172.21.15.18:0/3897427568 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) ==== 171+0+0 (secure 0 0 0) 0x7fe1b009c950 con 0x7fe1b8106f20 2024-09-19T08:43:12.485 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T08:43:12.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe1a00a3240 msgr2=0x7fe1a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe1a00a3240 0x7fe1a00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8031440 tx=0x7fe1a8005b50 comp rx=0 tx=0).stop 2024-09-19T08:43:12.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 msgr2=0x7fe1b819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 0x7fe1b819cb60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000cce0 tx=0x7fe1b000a620 comp rx=0 tx=0).stop 2024-09-19T08:43:12.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 shutdown_connections 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe1a00a3240 0x7fe1a00a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1b8106f20 0x7fe1b819cb60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1b81027a0 0x7fe1b81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 --2- 172.21.15.18:0/3897427568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b8101df0 0x7fe1b8198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.487+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 >> 172.21.15.18:0/3897427568 conn(0x7fe1b80fd8f0 msgr2=0x7fe1b80fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.488+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 shutdown_connections 2024-09-19T08:43:12.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:12.488+0000 7fe1bedb9640 1 -- 172.21.15.18:0/3897427568 wait complete. 2024-09-19T08:43:12.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:12 smithi150 ceph-mon[34610]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:43:12.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:12 smithi018 ceph-mon[30956]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:43:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:12 smithi162 ceph-mon[34870]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:43:13.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:43:13.409 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:13.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:13 smithi150 ceph-mon[34610]: pgmap v274: 33 pgs: 3 creating+activating, 6 creating+peering, 14 unknown, 10 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:13.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:13 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3897427568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T08:43:13.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:13 smithi150 ceph-mon[34610]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:43:13.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:13 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3897427568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T08:43:13.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:13 smithi150 ceph-mon[34610]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:43:13.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:13 smithi150 ceph-mon[34610]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:43:13.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:13 smithi018 ceph-mon[30956]: pgmap v274: 33 pgs: 3 creating+activating, 6 creating+peering, 14 unknown, 10 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:13.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:13 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3897427568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T08:43:13.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:13 smithi018 ceph-mon[30956]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:43:13.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:13 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3897427568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T08:43:13.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:13 smithi018 ceph-mon[30956]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:43:13.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:13 smithi018 ceph-mon[30956]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:43:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:13 smithi162 ceph-mon[34870]: pgmap v274: 33 pgs: 3 creating+activating, 6 creating+peering, 14 unknown, 10 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:13 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3897427568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T08:43:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:13 smithi162 ceph-mon[34870]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:43:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:13 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3897427568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T08:43:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:13 smithi162 ceph-mon[34870]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:43:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:13 smithi162 ceph-mon[34870]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:43:13.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.959+0000 7fcbdf673640 1 -- 172.21.15.18:0/312767555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 msgr2=0x7fcbd810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.959+0000 7fcbdf673640 1 --2- 172.21.15.18:0/312767555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd810df40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009900 tx=0x7fcbc802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 -- 172.21.15.18:0/312767555 shutdown_connections 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 --2- 172.21.15.18:0/312767555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbd810e480 0x7fcbd8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 --2- 172.21.15.18:0/312767555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd810df40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 --2- 172.21.15.18:0/312767555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd81008d0 0x7fcbd8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 -- 172.21.15.18:0/312767555 >> 172.21.15.18:0/312767555 conn(0x7fcbd80fc7a0 msgr2=0x7fcbd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 -- 172.21.15.18:0/312767555 shutdown_connections 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 -- 172.21.15.18:0/312767555 wait complete. 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 Processor -- start 2024-09-19T08:43:13.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 -- start start 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbd81008d0 0x7fcbd819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.960+0000 7fcbdf673640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd810e480 0x7fcbd819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdf673640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd8114060 con 0x7fcbd8101280 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdf673640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd8113ee0 con 0x7fcbd81008d0 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdf673640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd81141e0 con 0x7fcbd810e480 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54952/0 (socket says 172.21.15.18:54952) 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 -- 172.21.15.18:0/1313990600 learned_addr learned my addr 172.21.15.18:0/1313990600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbddc10640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd810e480 0x7fcbd819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdd40f640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbd81008d0 0x7fcbd819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 -- 172.21.15.18:0/1313990600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd810e480 msgr2=0x7fcbd819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd810e480 0x7fcbd819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 -- 172.21.15.18:0/1313990600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbd81008d0 msgr2=0x7fcbd819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbd81008d0 0x7fcbd819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 -- 172.21.15.18:0/1313990600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd819f610 con 0x7fcbd8101280 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbddc10640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd810e480 0x7fcbd819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdcc0e640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd819aba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8006010 tx=0x7fcbc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc803f030 con 0x7fcbd8101280 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbc80035f0 con 0x7fcbd8101280 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd819f8a0 con 0x7fcbd8101280 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8035070 con 0x7fcbd8101280 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.961+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd81a71e0 con 0x7fcbd8101280 2024-09-19T08:43:13.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.962+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd806b070 con 0x7fcbd8101280 2024-09-19T08:43:13.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.964+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcbc8003b10 con 0x7fcbd8101280 2024-09-19T08:43:13.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.964+0000 7fcbce7fc640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcbc40a3240 0x7fcbc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.964+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7fcbc80f05a0 con 0x7fcbd8101280 2024-09-19T08:43:13.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.964+0000 7fcbdd40f640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcbc40a3240 0x7fcbc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.965+0000 7fcbdd40f640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcbc40a3240 0x7fcbc40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40058c0 tx=0x7fcbd4005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:13.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:13.968+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbc80bd470 con 0x7fcbd8101280 2024-09-19T08:43:14.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.178+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcbd8109610 con 0x7fcbd8101280 2024-09-19T08:43:14.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.509+0000 7fcbce7fc640 1 -- 172.21.15.18:0/1313990600 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fcbc80bcd70 con 0x7fcbd8101280 2024-09-19T08:43:14.510 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T08:43:14.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcbc40a3240 msgr2=0x7fcbc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcbc40a3240 0x7fcbc40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40058c0 tx=0x7fcbd4005c60 comp rx=0 tx=0).stop 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 msgr2=0x7fcbd819aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd819aba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8006010 tx=0x7fcbc8004270 comp rx=0 tx=0).stop 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 shutdown_connections 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcbc40a3240 0x7fcbc40a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd810e480 0x7fcbd819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd8101280 0x7fcbd819aba0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 --2- 172.21.15.18:0/1313990600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbd81008d0 0x7fcbd819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 >> 172.21.15.18:0/1313990600 conn(0x7fcbd80fc7a0 msgr2=0x7fcbd80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 shutdown_connections 2024-09-19T08:43:14.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:14.512+0000 7fcbdf673640 1 -- 172.21.15.18:0/1313990600 wait complete. 2024-09-19T08:43:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:14 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1313990600' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:43:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:14 smithi150 ceph-mon[34610]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:43:14.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:14 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1313990600' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:43:14.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:14 smithi018 ceph-mon[30956]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:43:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:14 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1313990600' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:43:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:14 smithi162 ceph-mon[34870]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:43:15.225 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T08:43:15.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T08:43:15.489 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:15.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:15 smithi018 ceph-mon[30956]: pgmap v277: 97 pgs: 3 creating+activating, 6 creating+peering, 70 unknown, 18 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:15.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:15 smithi018 ceph-mon[30956]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:43:15.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:15 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1313990600' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:43:15.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:15 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:43:15.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:15 smithi018 ceph-mon[30956]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:43:15.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:15 smithi150 ceph-mon[34610]: pgmap v277: 97 pgs: 3 creating+activating, 6 creating+peering, 70 unknown, 18 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:15.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:15 smithi150 ceph-mon[34610]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:43:15.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:15 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1313990600' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:43:15.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:15 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:43:15.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:15 smithi150 ceph-mon[34610]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:43:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:15 smithi162 ceph-mon[34870]: pgmap v277: 97 pgs: 3 creating+activating, 6 creating+peering, 70 unknown, 18 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:15 smithi162 ceph-mon[34870]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:43:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:15 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1313990600' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:43:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:15 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:43:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:15 smithi162 ceph-mon[34870]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:43:15.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 -- 172.21.15.18:0/2405033782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c101430 msgr2=0x7f107c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 --2- 172.21.15.18:0/2405033782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c101430 0x7f107c10d960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1074009cd0 tx=0x7f107402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 -- 172.21.15.18:0/2405033782 shutdown_connections 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 --2- 172.21.15.18:0/2405033782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c101430 0x7f107c10d960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 --2- 172.21.15.18:0/2405033782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107c100a90 0x7f107c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 --2- 172.21.15.18:0/2405033782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f107c106a90 0x7f107c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 -- 172.21.15.18:0/2405033782 >> 172.21.15.18:0/2405033782 conn(0x7f107c0fc7d0 msgr2=0x7f107c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 -- 172.21.15.18:0/2405033782 shutdown_connections 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.989+0000 7f1081b67640 1 -- 172.21.15.18:0/2405033782 wait complete. 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.990+0000 7f1081b67640 1 Processor -- start 2024-09-19T08:43:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.990+0000 7f1081b67640 1 -- start start 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.990+0000 7f1081b67640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f107c100a90 0x7f107c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.990+0000 7f1081b67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107c101430 0x7f107c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1081b67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 0x7f107c1a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1081b67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f107c110d80 con 0x7f107c106a90 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1081b67640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f107c110c00 con 0x7f107c100a90 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1081b67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f107c110f00 con 0x7f107c101430 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 0x7f107c1a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 0x7f107c1a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54966/0 (socket says 172.21.15.18:54966) 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 -- 172.21.15.18:0/3417524515 learned_addr learned my addr 172.21.15.18:0/3417524515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107b7fe640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f107c100a90 0x7f107c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107affd640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107c101430 0x7f107c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 -- 172.21.15.18:0/3417524515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107c101430 msgr2=0x7f107c199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107c101430 0x7f107c199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 -- 172.21.15.18:0/3417524515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f107c100a90 msgr2=0x7f107c199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f107c100a90 0x7f107c199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 -- 172.21.15.18:0/3417524515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c1a47d0 con 0x7f107c106a90 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f107bfff640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 0x7f107c1a4290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1074005cc0 tx=0x7f1074003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074004450 con 0x7f107c106a90 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1074031c90 con 0x7f107c106a90 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.991+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c1a49a0 con 0x7f107c106a90 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.992+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074030e70 con 0x7f107c106a90 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.992+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c1a4e80 con 0x7f107c106a90 2024-09-19T08:43:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.993+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c100ef0 con 0x7f107c106a90 2024-09-19T08:43:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.994+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f10740045f0 con 0x7f107c106a90 2024-09-19T08:43:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.995+0000 7f1078ff9640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10680a3240 0x7f10680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.995+0000 7f107b7fe640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10680a3240 0x7f10680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.995+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f107402e030 con 0x7f107c106a90 2024-09-19T08:43:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.995+0000 7f107b7fe640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10680a3240 0x7f10680a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f106c009990 tx=0x7f106c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:15.998+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f107404b060 con 0x7f107c106a90 2024-09-19T08:43:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.181+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f107c109020 con 0x7f107c106a90 2024-09-19T08:43:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.520+0000 7f1078ff9640 1 -- 172.21.15.18:0/3417524515 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7f10740be040 con 0x7f107c106a90 2024-09-19T08:43:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10680a3240 msgr2=0x7f10680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10680a3240 0x7f10680a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f106c009990 tx=0x7f106c009110 comp rx=0 tx=0).stop 2024-09-19T08:43:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 msgr2=0x7f107c1a4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 0x7f107c1a4290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1074005cc0 tx=0x7f1074003c20 comp rx=0 tx=0).stop 2024-09-19T08:43:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 shutdown_connections 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f10680a3240 0x7f10680a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c106a90 0x7f107c1a4290 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f107c101430 0x7f107c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 --2- 172.21.15.18:0/3417524515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f107c100a90 0x7f107c199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 >> 172.21.15.18:0/3417524515 conn(0x7f107c0fc7d0 msgr2=0x7f107c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 shutdown_connections 2024-09-19T08:43:16.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:16.523+0000 7f1081b67640 1 -- 172.21.15.18:0/3417524515 wait complete. 2024-09-19T08:43:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:16 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] up:active 2024-09-19T08:43:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:16 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:16 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:16.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:16 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3417524515' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T08:43:16.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:16 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] up:active 2024-09-19T08:43:16.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:16 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:16.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:16 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:16.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:16 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3417524515' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T08:43:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:16 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] up:active 2024-09-19T08:43:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:16 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:16 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:16 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3417524515' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T08:43:17.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:43:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:17.780 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:17 smithi018 ceph-mon[30956]: pgmap v279: 97 pgs: 3 creating+activating, 17 unknown, 77 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-19T08:43:17.780 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:17 smithi018 ceph-mon[30956]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:43:17.780 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:17 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T08:43:17.780 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:17 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3417524515' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T08:43:17.780 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:17 smithi018 ceph-mon[30956]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:43:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:17 smithi150 ceph-mon[34610]: pgmap v279: 97 pgs: 3 creating+activating, 17 unknown, 77 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-19T08:43:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:17 smithi150 ceph-mon[34610]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:43:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:17 smithi150 ceph-mon[34610]: Cluster is now healthy 2024-09-19T08:43:17.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:17 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3417524515' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T08:43:17.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:17 smithi150 ceph-mon[34610]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:43:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:17 smithi162 ceph-mon[34870]: pgmap v279: 97 pgs: 3 creating+activating, 17 unknown, 77 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-19T08:43:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:17 smithi162 ceph-mon[34870]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:43:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:17 smithi162 ceph-mon[34870]: Cluster is now healthy 2024-09-19T08:43:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:17 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3417524515' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T08:43:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:17 smithi162 ceph-mon[34870]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 -- 172.21.15.18:0/1442647278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 msgr2=0x7fcb00103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/1442647278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb00103120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009900 tx=0x7fcaf002a480 comp rx=0 tx=0).stop 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 -- 172.21.15.18:0/1442647278 shutdown_connections 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/1442647278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb0010c170 0x7fcb0010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/1442647278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 0x7fcb0010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/1442647278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb00103120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 -- 172.21.15.18:0/1442647278 >> 172.21.15.18:0/1442647278 conn(0x7fcb000fc7a0 msgr2=0x7fcb000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.977+0000 7fcb05ac4640 1 -- 172.21.15.18:0/1442647278 shutdown_connections 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.978+0000 7fcb05ac4640 1 -- 172.21.15.18:0/1442647278 wait complete. 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.978+0000 7fcb05ac4640 1 Processor -- start 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.978+0000 7fcb05ac4640 1 -- start start 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.978+0000 7fcb05ac4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb001983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcb05ac4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 0x7fcb00198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcb05ac4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb0010c170 0x7fcb0019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcb05ac4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00111e20 con 0x7fcb00102d40 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcb05ac4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00111ca0 con 0x7fcb0010c170 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcb05ac4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00111fa0 con 0x7fcb00103660 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb001983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb001983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54990/0 (socket says 172.21.15.18:54990) 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 -- 172.21.15.18:0/3283397408 learned_addr learned my addr 172.21.15.18:0/3283397408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcafffff640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb0010c170 0x7fcb0019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcafeffd640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 0x7fcb00198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 -- 172.21.15.18:0/3283397408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 msgr2=0x7fcb00198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 0x7fcb00198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 -- 172.21.15.18:0/3283397408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb0010c170 msgr2=0x7fcb0019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb0010c170 0x7fcb0019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 -- 172.21.15.18:0/3283397408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0019d390 con 0x7fcb00102d40 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcafeffd640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 0x7fcb00198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcaff7fe640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb001983e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005940 tx=0x7fcaf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf003f030 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaf0003aa0 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0019d620 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.979+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0035070 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.980+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001a4f60 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.981+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0006b070 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.982+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcaf0042030 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.982+0000 7fcafcff9640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcae80a3240 0x7fcae80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.983+0000 7fcafeffd640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcae80a3240 0x7fcae80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.983+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8277+0+0 (secure 0 0 0) 0x7fcaf00f0200 con 0x7fcb00102d40 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.983+0000 7fcafeffd640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcae80a3240 0x7fcae80a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb000fee10 tx=0x7fcaf4009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:17.987+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcaf00bce90 con 0x7fcb00102d40 2024-09-19T08:43:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:18.162+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb001071e0 con 0x7fcb00102d40 2024-09-19T08:43:18.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:18 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3283397408' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:43:18.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3283397408' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:43:18.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:18 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3283397408' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:43:19.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.521+0000 7fcafcff9640 1 -- 172.21.15.18:0/3283397408 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) ==== 228+0+0 (secure 0 0 0) 0x7fcaf00bc790 con 0x7fcb00102d40 2024-09-19T08:43:19.521 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcae80a3240 msgr2=0x7fcae80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcae80a3240 0x7fcae80a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb000fee10 tx=0x7fcaf4009670 comp rx=0 tx=0).stop 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 msgr2=0x7fcb001983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb001983e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005940 tx=0x7fcaf0004270 comp rx=0 tx=0).stop 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 shutdown_connections 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcae80a3240 0x7fcae80a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb0010c170 0x7fcb0019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb00103660 0x7fcb00198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 --2- 172.21.15.18:0/3283397408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb00102d40 0x7fcb001983e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 >> 172.21.15.18:0/3283397408 conn(0x7fcb000fc7a0 msgr2=0x7fcb000fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:19.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 shutdown_connections 2024-09-19T08:43:19.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:19.525+0000 7fcb05ac4640 1 -- 172.21.15.18:0/3283397408 wait complete. 2024-09-19T08:43:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:19 smithi150 ceph-mon[34610]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:43:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:19 smithi150 ceph-mon[34610]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:43:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:19 smithi162 ceph-mon[34870]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:43:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:19 smithi162 ceph-mon[34870]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:43:19.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:19 smithi018 ceph-mon[30956]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:43:19.940 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:19 smithi018 ceph-mon[30956]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:43:20.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T08:43:20.315 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:43:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: 2024-09-19T08:43:19.904+0000 7f4ba706d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:43:20.510 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:20.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3283397408' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:43:20.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:20 smithi018 ceph-mon[30956]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:43:20.792 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:20 smithi018 ceph-mon[30956]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:43:20.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:20 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3283397408' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:43:20.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:20 smithi150 ceph-mon[34610]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:43:20.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:20 smithi150 ceph-mon[34610]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:43:20.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:20 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3283397408' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:43:20.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:20 smithi162 ceph-mon[34870]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:43:20.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:20 smithi162 ceph-mon[34870]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:43:21.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 -- 172.21.15.18:0/1369497643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 msgr2=0x7f370c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 --2- 172.21.15.18:0/1369497643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c10e610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3704009ca0 tx=0x7f370402a950 comp rx=0 tx=0).stop 2024-09-19T08:43:21.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 -- 172.21.15.18:0/1369497643 shutdown_connections 2024-09-19T08:43:21.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 --2- 172.21.15.18:0/1369497643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c10e610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 --2- 172.21.15.18:0/1369497643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370c103660 0x7f370c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 --2- 172.21.15.18:0/1369497643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f370c102d40 0x7f370c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 -- 172.21.15.18:0/1369497643 >> 172.21.15.18:0/1369497643 conn(0x7f370c0fc7a0 msgr2=0x7f370c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 -- 172.21.15.18:0/1369497643 shutdown_connections 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.006+0000 7f37110f6640 1 -- 172.21.15.18:0/1369497643 wait complete. 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.007+0000 7f37110f6640 1 Processor -- start 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.007+0000 7f37110f6640 1 -- start start 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370c102d40 0x7f370c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f370c103660 0x7f370c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f370c111e00 con 0x7f370c10c170 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f370c111c80 con 0x7f370c103660 2024-09-19T08:43:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f370c111f80 con 0x7f370c102d40 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57268/0 (socket says 172.21.15.18:57268) 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 -- 172.21.15.18:0/490271324 learned_addr learned my addr 172.21.15.18:0/490271324 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370259c640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f370c103660 0x7f370c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370ad9d640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370c102d40 0x7f370c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 -- 172.21.15.18:0/490271324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370c102d40 msgr2=0x7f370c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370c102d40 0x7f370c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 -- 172.21.15.18:0/490271324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f370c103660 msgr2=0x7f370c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f370c103660 0x7f370c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 -- 172.21.15.18:0/490271324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c1a6800 con 0x7f370c10c170 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f370b59e640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c101420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f370402ae70 tx=0x7f370402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704034040 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c1a6a90 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.008+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37040308f0 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.009+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040047f0 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.009+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c1a6f70 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.010+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370c103120 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.011+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3704037020 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.012+0000 7f3708d99640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f36f80a3240 0x7f36f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.012+0000 7f370ad9d640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f36f80a3240 0x7f36f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.012+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7f37040f0c90 con 0x7f370c10c170 2024-09-19T08:43:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.012+0000 7f370ad9d640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f36f80a3240 0x7f36f80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00bbe0 tx=0x7f36fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:21.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.015+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3704081210 con 0x7f370c10c170 2024-09-19T08:43:21.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.189+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f370c106c50 con 0x7f370c10c170 2024-09-19T08:43:21.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.535+0000 7f3708d99640 1 -- 172.21.15.18:0/490271324 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7f37040bd730 con 0x7f370c10c170 2024-09-19T08:43:21.536 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T08:43:21.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f36f80a3240 msgr2=0x7f36f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f36f80a3240 0x7f36f80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00bbe0 tx=0x7f36fc00b390 comp rx=0 tx=0).stop 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 msgr2=0x7f370c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c101420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f370402ae70 tx=0x7f370402f5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 shutdown_connections 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f36f80a3240 0x7f36f80a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f370c10c170 0x7f370c101420 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f370c103660 0x7f370c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 --2- 172.21.15.18:0/490271324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f370c102d40 0x7f370c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 >> 172.21.15.18:0/490271324 conn(0x7f370c0fc7a0 msgr2=0x7f370c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 shutdown_connections 2024-09-19T08:43:21.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:21.538+0000 7f37110f6640 1 -- 172.21.15.18:0/490271324 wait complete. 2024-09-19T08:43:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:21 smithi150 ceph-mon[34610]: pgmap v284: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:43:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:21 smithi150 ceph-mon[34610]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:43:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:21 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/490271324' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T08:43:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:21 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/490271324' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T08:43:21.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:21 smithi150 ceph-mon[34610]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:43:21.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:21 smithi018 ceph-mon[30956]: pgmap v284: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:43:21.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:21 smithi018 ceph-mon[30956]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:43:21.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/490271324' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T08:43:21.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/490271324' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T08:43:21.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:21 smithi018 ceph-mon[30956]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:43:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:21 smithi162 ceph-mon[34870]: pgmap v284: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:43:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:21 smithi162 ceph-mon[34870]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:43:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:21 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/490271324' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T08:43:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:21 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/490271324' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T08:43:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:21 smithi162 ceph-mon[34870]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:43:22.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T08:43:22.523 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 -- 172.21.15.18:0/1425671583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 msgr2=0x7f872810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 --2- 172.21.15.18:0/1425671583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f872810df40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8718009900 tx=0x7f871802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 -- 172.21.15.18:0/1425671583 shutdown_connections 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 --2- 172.21.15.18:0/1425671583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f872810e480 0x7f8728110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 --2- 172.21.15.18:0/1425671583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f872810df40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 --2- 172.21.15.18:0/1425671583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87281008d0 0x7f8728100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 -- 172.21.15.18:0/1425671583 >> 172.21.15.18:0/1425671583 conn(0x7f87280fc7a0 msgr2=0x7f87280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 -- 172.21.15.18:0/1425671583 shutdown_connections 2024-09-19T08:43:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.972+0000 7f87301a4640 1 -- 172.21.15.18:0/1425671583 wait complete. 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 Processor -- start 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 -- start start 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87281008d0 0x7f87281a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f87281a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f872810e480 0x7f872819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8728114110 con 0x7f8728101280 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8728113f90 con 0x7f87281008d0 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f87301a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8728114290 con 0x7f872810e480 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f872d73f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f87281a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f872d73f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f87281a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57286/0 (socket says 172.21.15.18:57286) 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.973+0000 7f872d73f640 1 -- 172.21.15.18:0/560417722 learned_addr learned my addr 172.21.15.18:0/560417722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872df40640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87281008d0 0x7f87281a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872e741640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f872810e480 0x7f872819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872d73f640 1 -- 172.21.15.18:0/560417722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f872810e480 msgr2=0x7f872819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872d73f640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f872810e480 0x7f872819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872d73f640 1 -- 172.21.15.18:0/560417722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87281008d0 msgr2=0x7f87281a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872d73f640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87281008d0 0x7f87281a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872d73f640 1 -- 172.21.15.18:0/560417722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872819ace0 con 0x7f8728101280 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f872d73f640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f87281a0930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8718005940 tx=0x7f8718004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871803f070 con 0x7f8728101280 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872819af70 con 0x7f8728101280 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8718003aa0 con 0x7f8728101280 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718035030 con 0x7f8728101280 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.974+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87281a72c0 con 0x7f8728101280 2024-09-19T08:43:23.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.975+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8728100d30 con 0x7f8728101280 2024-09-19T08:43:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.976+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8718042070 con 0x7f8728101280 2024-09-19T08:43:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.977+0000 7f871effd640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87140a3240 0x7f87140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.977+0000 7f872df40640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87140a3240 0x7f87140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.977+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7f87180f0bf0 con 0x7f8728101280 2024-09-19T08:43:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.977+0000 7f872df40640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87140a3240 0x7f87140a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8724009890 tx=0x7f8724008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:22.980+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87180bd6f0 con 0x7f8728101280 2024-09-19T08:43:23.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.194+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f8728109610 con 0x7f8728101280 2024-09-19T08:43:23.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.543+0000 7f871effd640 1 -- 172.21.15.18:0/560417722 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f87180bcff0 con 0x7f8728101280 2024-09-19T08:43:23.544 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 4 to fsmap 2024-09-19T08:43:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87140a3240 msgr2=0x7f87140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87140a3240 0x7f87140a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8724009890 tx=0x7f8724008040 comp rx=0 tx=0).stop 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 msgr2=0x7f87281a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f87281a0930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8718005940 tx=0x7f8718004430 comp rx=0 tx=0).stop 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 shutdown_connections 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87140a3240 0x7f87140a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f872810e480 0x7f872819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8728101280 0x7f87281a0930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 --2- 172.21.15.18:0/560417722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87281008d0 0x7f87281a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 >> 172.21.15.18:0/560417722 conn(0x7f87280fc7a0 msgr2=0x7f87280feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 shutdown_connections 2024-09-19T08:43:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:23.546+0000 7f87301a4640 1 -- 172.21.15.18:0/560417722 wait complete. 2024-09-19T08:43:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:23 smithi150 ceph-mon[34610]: pgmap v287: 129 pgs: 16 creating+peering, 8 unknown, 105 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:23 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/560417722' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T08:43:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:23 smithi162 ceph-mon[34870]: pgmap v287: 129 pgs: 16 creating+peering, 8 unknown, 105 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:23 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/560417722' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T08:43:23.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:23 smithi018 ceph-mon[30956]: pgmap v287: 129 pgs: 16 creating+peering, 8 unknown, 105 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:23.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:23 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/560417722' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T08:43:24.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:24.526 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:24 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/560417722' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T08:43:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:24 smithi150 ceph-mon[34610]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:43:24.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:24 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:24.898 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/560417722' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T08:43:24.898 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:24 smithi018 ceph-mon[30956]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:43:24.898 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:24 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:24.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:24 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/560417722' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T08:43:24.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:24 smithi162 ceph-mon[34870]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:43:24.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:24 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:25.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 -- 172.21.15.18:0/3666957463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98106f10 msgr2=0x7fac9810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 --2- 172.21.15.18:0/3666957463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98106f10 0x7fac9810ea90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac90009ca0 tx=0x7fac9002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 -- 172.21.15.18:0/3666957463 shutdown_connections 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 --2- 172.21.15.18:0/3666957463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98106f10 0x7fac9810ea90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 --2- 172.21.15.18:0/3666957463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98102790 0x7fac981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 --2- 172.21.15.18:0/3666957463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac98101de0 0x7fac981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 -- 172.21.15.18:0/3666957463 >> 172.21.15.18:0/3666957463 conn(0x7fac980fd8c0 msgr2=0x7fac980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 -- 172.21.15.18:0/3666957463 shutdown_connections 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.979+0000 7fac9cbda640 1 -- 172.21.15.18:0/3666957463 wait complete. 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 Processor -- start 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 -- start start 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac98101de0 0x7fac98198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 0x7fac98198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98106f10 0x7fac9819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac98111e20 con 0x7fac98102790 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac98111ca0 con 0x7fac98106f10 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9cbda640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac98111fa0 con 0x7fac98101de0 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac95d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 0x7fac98198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac95d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 0x7fac98198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57306/0 (socket says 172.21.15.18:57306) 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac95d9b640 1 -- 172.21.15.18:0/463666371 learned_addr learned my addr 172.21.15.18:0/463666371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.980+0000 7fac9659c640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac98101de0 0x7fac98198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac96d9d640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98106f10 0x7fac9819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac95d9b640 1 -- 172.21.15.18:0/463666371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac98101de0 msgr2=0x7fac98198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac95d9b640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac98101de0 0x7fac98198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac95d9b640 1 -- 172.21.15.18:0/463666371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98106f10 msgr2=0x7fac9819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac95d9b640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98106f10 0x7fac9819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac95d9b640 1 -- 172.21.15.18:0/463666371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9819d2d0 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac96d9d640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98106f10 0x7fac9819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac95d9b640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 0x7fac98198860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac8000d950 tx=0x7fac8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80017070 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac80009c30 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9819d5c0 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8000f620 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.981+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac981a4ea0 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.982+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac981021c0 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.983+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fac800109a0 con 0x7fac98102790 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.984+0000 7fac8f7fe640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac840a3240 0x7fac840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.984+0000 7fac9659c640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac840a3240 0x7fac840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.984+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fac800cf790 con 0x7fac98102790 2024-09-19T08:43:25.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.985+0000 7fac9659c640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac840a3240 0x7fac840a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fac88005fd0 tx=0x7fac8800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:25.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:24.988+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac80009de0 con 0x7fac98102790 2024-09-19T08:43:25.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.200+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac98199680 con 0x7fac98102790 2024-09-19T08:43:25.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.201+0000 7fac8f7fe640 1 -- 172.21.15.18:0/463666371 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7fac8009c210 con 0x7fac98102790 2024-09-19T08:43:25.202 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:25.202 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"btime":"2024-09-19T08:43:23:543363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:23.196098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:43:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-19T08:43:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac840a3240 msgr2=0x7fac840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac840a3240 0x7fac840a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fac88005fd0 tx=0x7fac8800b390 comp rx=0 tx=0).stop 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 msgr2=0x7fac98198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 0x7fac98198860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac8000d950 tx=0x7fac8000de10 comp rx=0 tx=0).stop 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 shutdown_connections 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac840a3240 0x7fac840a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac98106f10 0x7fac9819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac98102790 0x7fac98198860 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 --2- 172.21.15.18:0/463666371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac98101de0 0x7fac98198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 >> 172.21.15.18:0/463666371 conn(0x7fac980fd8c0 msgr2=0x7fac980fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 shutdown_connections 2024-09-19T08:43:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:25.203+0000 7fac9cbda640 1 -- 172.21.15.18:0/463666371 wait complete. 2024-09-19T08:43:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:25 smithi150 ceph-mon[34610]: pgmap v289: 129 pgs: 16 creating+peering, 6 unknown, 107 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:25 smithi150 ceph-mon[34610]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T08:43:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:25 smithi150 ceph-mon[34610]: Cluster is now healthy 2024-09-19T08:43:25.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:25 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/463666371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:25.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:25 smithi018 ceph-mon[30956]: pgmap v289: 129 pgs: 16 creating+peering, 6 unknown, 107 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:25.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:25 smithi018 ceph-mon[30956]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T08:43:25.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:25 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T08:43:25.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:25 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/463666371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:25.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:25 smithi162 ceph-mon[34870]: pgmap v289: 129 pgs: 16 creating+peering, 6 unknown, 107 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:25 smithi162 ceph-mon[34870]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T08:43:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:25 smithi162 ceph-mon[34870]: Cluster is now healthy 2024-09-19T08:43:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:25 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/463666371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:26.130 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:26.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 -- 172.21.15.18:0/28450140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c0104010 msgr2=0x7ff2c01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/28450140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c0104010 0x7ff2c01043f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009900 tx=0x7ff2b002a410 comp rx=0 tx=0).stop 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 -- 172.21.15.18:0/28450140 shutdown_connections 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/28450140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c0109140 0x7ff2c0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/28450140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2c01049c0 0x7ff2c0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/28450140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c0104010 0x7ff2c01043f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 -- 172.21.15.18:0/28450140 >> 172.21.15.18:0/28450140 conn(0x7ff2c00ffa50 msgr2=0x7ff2c0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 -- 172.21.15.18:0/28450140 shutdown_connections 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 -- 172.21.15.18:0/28450140 wait complete. 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.577+0000 7ff2c57a7640 1 Processor -- start 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 -- start start 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c0104010 0x7ff2c019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 0x7ff2c019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2c0109140 0x7ff2c019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01140c0 con 0x7ff2c01049c0 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0113f40 con 0x7ff2c0109140 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2c57a7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0114240 con 0x7ff2c0104010 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 0x7ff2c019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 0x7ff2c019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57314/0 (socket says 172.21.15.18:57314) 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 -- 172.21.15.18:0/812445935 learned_addr learned my addr 172.21.15.18:0/812445935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2bf7fe640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2c0109140 0x7ff2c019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2beffd640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c0104010 0x7ff2c019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 -- 172.21.15.18:0/812445935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c0104010 msgr2=0x7ff2c019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c0104010 0x7ff2c019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 -- 172.21.15.18:0/812445935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2c0109140 msgr2=0x7ff2c019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2c0109140 0x7ff2c019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.578+0000 7ff2be7fc640 1 -- 172.21.15.18:0/812445935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c019f5a0 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.579+0000 7ff2be7fc640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 0x7ff2c019ab30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c890 tx=0x7ff2a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.579+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8004220 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.579+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2a80043c0 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.579+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c019f890 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.579+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8004a00 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.579+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01a7170 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.580+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c01043f0 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.581+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff2a8004ba0 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.582+0000 7ff2b7fff640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2ac0a3240 0x7ff2ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.582+0000 7ff2beffd640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2ac0a3240 0x7ff2ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.582+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ff2a80cf8b0 con 0x7ff2c01049c0 2024-09-19T08:43:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.582+0000 7ff2beffd640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2ac0a3240 0x7ff2ac0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000c00 tx=0x7ff2b0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.586+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2a8014030 con 0x7ff2c01049c0 2024-09-19T08:43:26.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.762+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2c002d7c0 con 0x7ff2c01049c0 2024-09-19T08:43:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.763+0000 7ff2b7fff640 1 -- 172.21.15.18:0/812445935 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7ff2a809c330 con 0x7ff2c01049c0 2024-09-19T08:43:26.764 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:26.764 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2ac0a3240 msgr2=0x7ff2ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2ac0a3240 0x7ff2ac0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000c00 tx=0x7ff2b0031400 comp rx=0 tx=0).stop 2024-09-19T08:43:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 msgr2=0x7ff2c019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 0x7ff2c019ab30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c890 tx=0x7ff2a800cd50 comp rx=0 tx=0).stop 2024-09-19T08:43:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 shutdown_connections 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2ac0a3240 0x7ff2ac0a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2c0109140 0x7ff2c019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c01049c0 0x7ff2c019ab30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 --2- 172.21.15.18:0/812445935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2c0104010 0x7ff2c019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 >> 172.21.15.18:0/812445935 conn(0x7ff2c00ffa50 msgr2=0x7ff2c0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 shutdown_connections 2024-09-19T08:43:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:26.766+0000 7ff2c57a7640 1 -- 172.21.15.18:0/812445935 wait complete. 2024-09-19T08:43:27.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:27.653 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:27.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:27 smithi018 ceph-mon[30956]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:27.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/812445935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:27 smithi150 ceph-mon[34610]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:27 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/812445935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:27 smithi162 ceph-mon[34870]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:27 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/812445935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 -- 172.21.15.18:0/2392164596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 msgr2=0x7f7874103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 --2- 172.21.15.18:0/2392164596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f7874103120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7864009ca0 tx=0x7f786402a950 comp rx=0 tx=0).stop 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 -- 172.21.15.18:0/2392164596 shutdown_connections 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 --2- 172.21.15.18:0/2392164596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410c170 0x7f787410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 --2- 172.21.15.18:0/2392164596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 0x7f787410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 --2- 172.21.15.18:0/2392164596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f7874103120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.060+0000 7f78797a0640 1 -- 172.21.15.18:0/2392164596 >> 172.21.15.18:0/2392164596 conn(0x7f78740fc7a0 msgr2=0x7f78740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.061+0000 7f78797a0640 1 -- 172.21.15.18:0/2392164596 shutdown_connections 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.061+0000 7f78797a0640 1 -- 172.21.15.18:0/2392164596 wait complete. 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.061+0000 7f78797a0640 1 Processor -- start 2024-09-19T08:43:28.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 -- start start 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f78741009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 0x7f7874100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410c170 0x7f7874101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7874111e20 con 0x7f7874102d40 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7874111ca0 con 0x7f7874103660 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78797a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7874111fa0 con 0x7f787410c170 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f78741009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f78741009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57326/0 (socket says 172.21.15.18:57326) 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 -- 172.21.15.18:0/2227618144 learned_addr learned my addr 172.21.15.18:0/2227618144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78727fc640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 0x7f7874100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 -- 172.21.15.18:0/2227618144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410c170 msgr2=0x7f7874101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410c170 0x7f7874101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 -- 172.21.15.18:0/2227618144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 msgr2=0x7f7874100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 0x7f7874100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 -- 172.21.15.18:0/2227618144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78741a68c0 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f78727fc640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 0x7f7874100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.062+0000 7f7872ffd640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f78741009a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7864005cc0 tx=0x7f786402f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.063+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864034040 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.063+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f786402fe80 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.063+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640046a0 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.063+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78741a6b50 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.063+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78741a7030 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.064+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7874103120 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.065+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7864037020 con 0x7f7874102d40 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.066+0000 7f785bfff640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f785c0a3240 0x7f785c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.066+0000 7f78727fc640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f785c0a3240 0x7f785c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.066+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f78640f0b20 con 0x7f7874102d40 2024-09-19T08:43:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.066+0000 7f78727fc640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f785c0a3240 0x7f785c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7874102430 tx=0x7f7868005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.070+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78640bd5a0 con 0x7f7874102d40 2024-09-19T08:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.247+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7874107210 con 0x7f7874102d40 2024-09-19T08:43:28.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.248+0000 7f785bfff640 1 -- 172.21.15.18:0/2227618144 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7f78640bcea0 con 0x7f7874102d40 2024-09-19T08:43:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:28.249 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f785c0a3240 msgr2=0x7f785c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f785c0a3240 0x7f785c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7874102430 tx=0x7f7868005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 msgr2=0x7f78741009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f78741009a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7864005cc0 tx=0x7f786402f650 comp rx=0 tx=0).stop 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 shutdown_connections 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f785c0a3240 0x7f785c0a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f787410c170 0x7f7874101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7874103660 0x7f7874100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 --2- 172.21.15.18:0/2227618144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7874102d40 0x7f78741009a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.250+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 >> 172.21.15.18:0/2227618144 conn(0x7f78740fc7a0 msgr2=0x7f78740fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:28.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.251+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 shutdown_connections 2024-09-19T08:43:28.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:28.251+0000 7f78797a0640 1 -- 172.21.15.18:0/2227618144 wait complete. 2024-09-19T08:43:28.788 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2227618144' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:28.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:28 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2227618144' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:28.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:28.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:28 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2227618144' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:29.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 -- 172.21.15.18:0/322916462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb28102df0 msgr2=0x7fbb281031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 --2- 172.21.15.18:0/322916462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb28102df0 0x7fbb281031d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009900 tx=0x7fbb1802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 -- 172.21.15.18:0/322916462 shutdown_connections 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 --2- 172.21.15.18:0/322916462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb2810c2f0 0x7fbb2810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 --2- 172.21.15.18:0/322916462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb281037a0 0x7fbb2810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 --2- 172.21.15.18:0/322916462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb28102df0 0x7fbb281031d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 -- 172.21.15.18:0/322916462 >> 172.21.15.18:0/322916462 conn(0x7fbb280fc7d0 msgr2=0x7fbb280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 -- 172.21.15.18:0/322916462 shutdown_connections 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.645+0000 7fbb2e652640 1 -- 172.21.15.18:0/322916462 wait complete. 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 Processor -- start 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 -- start start 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb28102df0 0x7fbb281984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb281037a0 0x7fbb281989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 0x7fbb2819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28111fa0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28111e20 con 0x7fbb28102df0 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2e652640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28112120 con 0x7fbb281037a0 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2cbef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 0x7fbb2819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2cbef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 0x7fbb2819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40932/0 (socket says 172.21.15.18:40932) 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb2cbef640 1 -- 172.21.15.18:0/3866285669 learned_addr learned my addr 172.21.15.18:0/3866285669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb277fe640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb281037a0 0x7fbb281989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.646+0000 7fbb27fff640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb28102df0 0x7fbb281984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2cbef640 1 -- 172.21.15.18:0/3866285669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb281037a0 msgr2=0x7fbb281989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2cbef640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb281037a0 0x7fbb281989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2cbef640 1 -- 172.21.15.18:0/3866285669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb28102df0 msgr2=0x7fbb281984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2cbef640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb28102df0 0x7fbb281984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2cbef640 1 -- 172.21.15.18:0/3866285669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2819d450 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb27fff640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb28102df0 0x7fbb281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2cbef640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 0x7fbb2819cd70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000eaa0 tx=0x7fbb2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000cdb0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb20005020 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2819d740 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb200116d0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.647+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb281a5020 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.648+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2806a790 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.650+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb200051d0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.651+0000 7fbb257fa640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbb100a3240 0x7fbb100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.651+0000 7fbb27fff640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbb100a3240 0x7fbb100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.651+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fbb200d01b0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.651+0000 7fbb27fff640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbb100a3240 0x7fbb100a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb18031440 tx=0x7fbb18005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:29.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.654+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb20016030 con 0x7fbb2810c2f0 2024-09-19T08:43:29.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:29 smithi150 ceph-mon[34610]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:29.818 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:29 smithi162 ceph-mon[34870]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:29.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.869+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb281031d0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:29 smithi018 ceph-mon[30956]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:29.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.870+0000 7fbb257fa640 1 -- 172.21.15.18:0/3866285669 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7fbb281031d0 con 0x7fbb2810c2f0 2024-09-19T08:43:29.871 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:29.871 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"btime":"2024-09-19T08:43:23:543363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:23.196098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:43:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.872+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbb100a3240 msgr2=0x7fbb100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.872+0000 7fbb2e652640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbb100a3240 0x7fbb100a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb18031440 tx=0x7fbb18005a20 comp rx=0 tx=0).stop 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.872+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 msgr2=0x7fbb2819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.872+0000 7fbb2e652640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 0x7fbb2819cd70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000eaa0 tx=0x7fbb2000ef60 comp rx=0 tx=0).stop 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 shutdown_connections 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbb100a3240 0x7fbb100a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2810c2f0 0x7fbb2819cd70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb281037a0 0x7fbb281989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 --2- 172.21.15.18:0/3866285669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb28102df0 0x7fbb281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 >> 172.21.15.18:0/3866285669 conn(0x7fbb280fc7d0 msgr2=0x7fbb280fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 shutdown_connections 2024-09-19T08:43:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:29.873+0000 7fbb2e652640 1 -- 172.21.15.18:0/3866285669 wait complete. 2024-09-19T08:43:30.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:30.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:30 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3866285669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:30.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:30 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3866285669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:30.961 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:30 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3866285669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 -- 172.21.15.18:0/894106298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd010c170 msgr2=0x7fadd010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 --2- 172.21.15.18:0/894106298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd010c170 0x7fadd010e610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009ca0 tx=0x7fadc802a950 comp rx=0 tx=0).stop 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 -- 172.21.15.18:0/894106298 shutdown_connections 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 --2- 172.21.15.18:0/894106298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd010c170 0x7fadd010e610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 --2- 172.21.15.18:0/894106298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd0103660 0x7fadd010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 --2- 172.21.15.18:0/894106298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd0102d40 0x7fadd0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 -- 172.21.15.18:0/894106298 >> 172.21.15.18:0/894106298 conn(0x7fadd00fc7a0 msgr2=0x7fadd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 -- 172.21.15.18:0/894106298 shutdown_connections 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.320+0000 7fadd70d4640 1 -- 172.21.15.18:0/894106298 wait complete. 2024-09-19T08:43:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 Processor -- start 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 -- start start 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 0x7fadd0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd0103660 0x7fadd01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd010c170 0x7fadd019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0111de0 con 0x7fadd0102d40 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0111c60 con 0x7fadd0103660 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd70d4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0111f60 con 0x7fadd010c170 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 0x7fadd0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 0x7fadd0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40942/0 (socket says 172.21.15.18:40942) 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 -- 172.21.15.18:0/3385401661 learned_addr learned my addr 172.21.15.18:0/3385401661 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 -- 172.21.15.18:0/3385401661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd010c170 msgr2=0x7fadd019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd010c170 0x7fadd019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 -- 172.21.15.18:0/3385401661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd0103660 msgr2=0x7fadd01987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd0103660 0x7fadd01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.321+0000 7fadd4e70640 1 -- 172.21.15.18:0/3385401661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd019d230 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.322+0000 7fadd4e70640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 0x7fadd0198280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c920 tx=0x7fadc000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.322+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0007c70 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.322+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fadc0007e10 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.322+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd019d520 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.322+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0018820 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.322+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd01a4e00 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.323+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd0103120 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.324+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fadc00189c0 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.325+0000 7fadcdffb640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fadbc0a32c0 0x7fadbc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.325+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fadc00cfcf0 con 0x7fadd0102d40 2024-09-19T08:43:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.325+0000 7fadcffff640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fadbc0a32c0 0x7fadbc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.325+0000 7fadcffff640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fadbc0a32c0 0x7fadbc0a5780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadd00fed30 tx=0x7fadb8009630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.329+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fadc00d4070 con 0x7fadd0102d40 2024-09-19T08:43:31.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.505+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadd0106c80 con 0x7fadd0102d40 2024-09-19T08:43:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.507+0000 7fadcdffb640 1 -- 172.21.15.18:0/3385401661 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7fadc0014030 con 0x7fadd0102d40 2024-09-19T08:43:31.508 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:31.508 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:31.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fadbc0a32c0 msgr2=0x7fadbc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fadbc0a32c0 0x7fadbc0a5780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadd00fed30 tx=0x7fadb8009630 comp rx=0 tx=0).stop 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 msgr2=0x7fadd0198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 0x7fadd0198280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c920 tx=0x7fadc000cde0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 shutdown_connections 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fadbc0a32c0 0x7fadbc0a5780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd010c170 0x7fadd019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd0103660 0x7fadd01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 --2- 172.21.15.18:0/3385401661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadd0102d40 0x7fadd0198280 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 >> 172.21.15.18:0/3385401661 conn(0x7fadd00fc7a0 msgr2=0x7fadd00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 shutdown_connections 2024-09-19T08:43:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:31.509+0000 7fadd70d4640 1 -- 172.21.15.18:0/3385401661 wait complete. 2024-09-19T08:43:31.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:31 smithi018 ceph-mon[30956]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:31.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:31 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3385401661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:31 smithi162 ceph-mon[34870]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:31 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3385401661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:31 smithi150 ceph-mon[34610]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:31 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3385401661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:32.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T08:43:14.179526+0000', 'modified': '2024-09-19T08:43:23.196098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.150:6839/3054116303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6838', 'nonce': 3054116303}, {'type': 'v1', 'addr': '172.21.15.150:6839', 'nonce': 3054116303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-19T08:43:32.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:43:32.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:43:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:33.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 -- 172.21.15.18:0/1689673793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c101dd0 msgr2=0x7f486c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 --2- 172.21.15.18:0/1689673793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c101dd0 0x7f486c1021b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4868009900 tx=0x7f486802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 -- 172.21.15.18:0/1689673793 shutdown_connections 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 --2- 172.21.15.18:0/1689673793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f486c106f00 0x7f486c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 --2- 172.21.15.18:0/1689673793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c102780 0x7f486c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 --2- 172.21.15.18:0/1689673793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c101dd0 0x7f486c1021b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 -- 172.21.15.18:0/1689673793 >> 172.21.15.18:0/1689673793 conn(0x7f486c0fd890 msgr2=0x7f486c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 -- 172.21.15.18:0/1689673793 shutdown_connections 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.075+0000 7f4873275640 1 -- 172.21.15.18:0/1689673793 wait complete. 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 Processor -- start 2024-09-19T08:43:33.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 -- start start 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c101dd0 0x7f486c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f486c102780 0x7f486c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 0x7f486c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f486c111e10 con 0x7f486c106f00 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f486c111c90 con 0x7f486c101dd0 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4873275640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f486c111f90 con 0x7f486c102780 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4871812640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 0x7f486c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4871812640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 0x7f486c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40968/0 (socket says 172.21.15.18:40968) 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4871812640 1 -- 172.21.15.18:0/18604860 learned_addr learned my addr 172.21.15.18:0/18604860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4871011640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c101dd0 0x7f486c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.076+0000 7f4870810640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f486c102780 0x7f486c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871812640 1 -- 172.21.15.18:0/18604860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f486c102780 msgr2=0x7f486c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871812640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f486c102780 0x7f486c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871812640 1 -- 172.21.15.18:0/18604860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c101dd0 msgr2=0x7f486c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871812640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c101dd0 0x7f486c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871812640 1 -- 172.21.15.18:0/18604860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c19d3c0 con 0x7f486c106f00 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871011640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c101dd0 0x7f486c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4871812640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 0x7f486c19cce0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4864009fd0 tx=0x7f486400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f48627fc640 1 -- 172.21.15.18:0/18604860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864017070 con 0x7f486c106f00 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486c19d6b0 con 0x7f486c106f00 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f48627fc640 1 -- 172.21.15.18:0/18604860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4864003e20 con 0x7f486c106f00 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f48627fc640 1 -- 172.21.15.18:0/18604860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864010460 con 0x7f486c106f00 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.077+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f486c1a4f90 con 0x7f486c106f00 2024-09-19T08:43:33.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.079+0000 7f48627fc640 1 -- 172.21.15.18:0/18604860 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4864003970 con 0x7f486c106f00 2024-09-19T08:43:33.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 Processor -- start 2024-09-19T08:43:33.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 -- start start 2024-09-19T08:43:33.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a79cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a88a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a8b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a3f69e0090 con 0x55a3f6a798d0 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6987a70 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f487564e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3f69dc050 con 0x55a3f6a88fc0 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f48627fc640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48580a3240 0x7f48580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f4870810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a79cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f4870810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a79cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40974/0 (socket says 172.21.15.18:40974) 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f4870810640 1 -- 172.21.15.18:0/1491876487 learned_addr learned my addr 172.21.15.18:0/1491876487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f4871812640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48580a3240 0x7f48580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f4870810640 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a8b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f4871011640 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.080+0000 7f48627fc640 1 -- 172.21.15.18:0/18604860 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f48640cf9b0 con 0x7f486c106f00 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4870810640 1 -- 172.21.15.18:0/1491876487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 msgr2=0x55a3f6a8b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4870810640 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a8b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4870810640 1 -- 172.21.15.18:0/1491876487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 msgr2=0x55a3f6a88a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4870810640 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a88a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4870810640 1 -- 172.21.15.18:0/1491876487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3f6994130 con 0x55a3f6a798d0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4871011640 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a88a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4870810640 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a79cb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f485c0127d0 tx=0x7f485c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67d0ab63ca344a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f4871812640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48580a3240 0x7f48580a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f486406eb80 tx=0x7f48640c6b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f48577fe640 1 -- 172.21.15.18:0/1491876487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0120d0 con 0x55a3f6a798d0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f48577fe640 1 -- 172.21.15.18:0/1491876487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f485c005020 con 0x55a3f6a798d0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.081+0000 7f48577fe640 1 -- 172.21.15.18:0/1491876487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c004a00 con 0x55a3f6a798d0 2024-09-19T08:43:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 -- 172.21.15.18:0/1491876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 msgr2=0x55a3f6a79cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a79cb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f485c0127d0 tx=0x7f485c00b840 comp rx=0 tx=0).stop 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 -- 172.21.15.18:0/1491876487 shutdown_connections 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a8b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a88a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 --2- 172.21.15.18:0/1491876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a79cb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 -- 172.21.15.18:0/1491876487 >> 172.21.15.18:0/1491876487 conn(0x55a3f6a75f60 msgr2=0x55a3f6a76340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 -- 172.21.15.18:0/1491876487 shutdown_connections 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 -- 172.21.15.18:0/1491876487 wait complete. 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 -- start start 2024-09-19T08:43:33.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.082+0000 7f487564e740 1 Processor -- start 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a798d0 0x55a3f6a88890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a85be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a8bb90 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a3f699af20 con 0x55a3f6a88fc0 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a8bd10 con 0x55a3f6a798d0 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f487564e740 10 client.0 _ll_register_callbacks cb 0x55a3f6964030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a85be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a85be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40976/0 (socket says 172.21.15.18:40976) 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 -- 172.21.15.18:0/742153266 learned_addr learned my addr 172.21.15.18:0/742153266 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4870810640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4870810640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a798d0 0x55a3f6a88890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 -- 172.21.15.18:0/742153266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a798d0 msgr2=0x55a3f6a88890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a798d0 0x55a3f6a88890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 -- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 msgr2=0x55a3f6a86120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a86120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 -- 172.21.15.18:0/742153266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3f67512b0 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4870810640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4871011640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a85be0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f486802a930 tx=0x7f48680316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813949832b2f98f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.083+0000 7f4854ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f4854ff9640 1 -- 172.21.15.18:0/742153266 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868035070 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f4854ff9640 1 -- 172.21.15.18:0/742153266 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f4868004240 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f485c005020 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f4854ff9640 1 -- 172.21.15.18:0/742153266 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4868004440 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 10 client.14730 fetch_fsmap learned FSMap version 17 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55a3f6a97520 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f4854ff9640 1 -- 172.21.15.18:0/742153266 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f485c005020 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f4854ff9640 1 -- 172.21.15.18:0/742153266 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4868004aa0 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 10 client.14730 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 10 client.14730 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:43:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 20 client.14730 populate_metadata read hostname 'smithi018' 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6a9afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 4 client.14730 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.084+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3f69ed600 con 0x55a3f6a99b40 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.085+0000 7f4870810640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6a9afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.085+0000 7f4854ff9640 10 client.14730 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.085+0000 7f4870810640 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6a9afb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58688b538d8561eb server_cookie=ee6d5dd1e2a35b68 in_seq=0 out_seq=0 2024-09-19T08:43:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f4854ff9640 1 -- 172.21.15.18:0/742153266 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3f69ed600 con 0x55a3f6a99b40 2024-09-19T08:43:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f4854ff9640 10 client.14730 handle_command_reply: tid=0 2024-09-19T08:43:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 client.14730 shutdown 2024-09-19T08:43:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 msgr2=0x55a3f6a85be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a85be0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f486802a930 tx=0x7f48680316d0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 shutdown_connections 2024-09-19T08:43:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6a9afb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f4854ff9640 0 client.14730 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:43:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a85be0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 --2- 172.21.15.18:0/742153266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a798d0 0x55a3f6a88890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 >> 172.21.15.18:0/742153266 conn(0x55a3f6a75f60 msgr2=0x55a3f6a7bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 shutdown_connections 2024-09-19T08:43:33.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 1 -- 172.21.15.18:0/742153266 wait complete. 2024-09-19T08:43:33.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.086+0000 7f487564e740 20 client.14730 trim_cache size 0 max 16384 2024-09-19T08:43:33.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 Processor -- start 2024-09-19T08:43:33.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 -- start start 2024-09-19T08:43:33.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a9a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a82e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a83380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a992f0 con 0x55a3f6a798d0 2024-09-19T08:43:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a999c0 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f487564e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a9a090 con 0x55a3f6a88fc0 2024-09-19T08:43:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a9a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a9a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40986/0 (socket says 172.21.15.18:40986) 2024-09-19T08:43:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 -- 172.21.15.18:0/2572050407 learned_addr learned my addr 172.21.15.18:0/2572050407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 -- 172.21.15.18:0/2572050407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 msgr2=0x55a3f6a83380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a83380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 -- 172.21.15.18:0/2572050407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 msgr2=0x55a3f6a82e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a82e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.104+0000 7f4870810640 1 -- 172.21.15.18:0/2572050407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3f6a86c20 con 0x55a3f6a798d0 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f4870810640 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a9a210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f485c0057c0 tx=0x7f485c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b04442ffe563bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f4856ffd640 1 -- 172.21.15.18:0/2572050407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c027070 con 0x55a3f6a798d0 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f4856ffd640 1 -- 172.21.15.18:0/2572050407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f485c00edd0 con 0x55a3f6a798d0 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f4856ffd640 1 -- 172.21.15.18:0/2572050407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c003ae0 con 0x55a3f6a798d0 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 -- 172.21.15.18:0/2572050407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 msgr2=0x55a3f6a9a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a9a210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f485c0057c0 tx=0x7f485c005bf0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 -- 172.21.15.18:0/2572050407 shutdown_connections 2024-09-19T08:43:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a83380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a82e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 --2- 172.21.15.18:0/2572050407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6a9a210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 -- 172.21.15.18:0/2572050407 >> 172.21.15.18:0/2572050407 conn(0x55a3f6a75f60 msgr2=0x55a3f6a844b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 -- 172.21.15.18:0/2572050407 shutdown_connections 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.105+0000 7f487564e740 1 -- 172.21.15.18:0/2572050407 wait complete. 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 -- start start 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 Processor -- start 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6aa36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a9c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a9cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a9ae30 con 0x55a3f6a798d0 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a9a760 con 0x55a3f6a88fc0 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6a9b500 con 0x55a3f6a7a1f0 2024-09-19T08:43:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f487564e740 10 client.0 _ll_register_callbacks cb 0x7f4868009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f4870810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6aa36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f4870810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6aa36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40988/0 (socket says 172.21.15.18:40988) 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f4870810640 1 -- 172.21.15.18:0/3088637187 learned_addr learned my addr 172.21.15.18:0/3088637187 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.106+0000 7f4871011640 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a9c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4870810640 1 -- 172.21.15.18:0/3088637187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a7a1f0 msgr2=0x55a3f6a9c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4870810640 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a9c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4870810640 1 -- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 msgr2=0x55a3f6a9cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4870810640 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a9cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4870810640 1 -- 172.21.15.18:0/3088637187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3f6a9d450 con 0x55a3f6a798d0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4870810640 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6aa36a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f485c006010 tx=0x7f485c00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9d9a696b92fe00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4854ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4854ff9640 1 -- 172.21.15.18:0/3088637187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c027070 con 0x55a3f6a798d0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4854ff9640 1 -- 172.21.15.18:0/3088637187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f485c0035f0 con 0x55a3f6a798d0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f485c00edd0 con 0x55a3f6a798d0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4854ff9640 1 -- 172.21.15.18:0/3088637187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f485c03b050 con 0x55a3f6a798d0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 10 client.14736 fetch_fsmap learned FSMap version 17 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55a3f6aa1eb0 con 0x55a3f6a798d0 2024-09-19T08:43:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4854ff9640 1 -- 172.21.15.18:0/3088637187 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f485c00edd0 con 0x55a3f6a798d0 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f4854ff9640 1 -- 172.21.15.18:0/3088637187 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f485c0374b0 con 0x55a3f6a798d0 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 10 client.14736 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 10 client.14736 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 20 client.14736 populate_metadata read hostname 'smithi018' 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.107+0000 7f487564e740 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6b06fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f487564e740 4 client.14736 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "status"}) -- 0x55a3f69e7b10 con 0x55a3f6a99b40 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f4871011640 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6b06fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f4854ff9640 10 client.14736 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f4871011640 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6b06fd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67bf968c076cdb22 server_cookie=2ef5fe6074479cdd in_seq=0 out_seq=0 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f4854ff9640 1 -- 172.21.15.18:0/3088637187 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55a3f69e7b10 con 0x55a3f6a99b40 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f4854ff9640 10 client.14736 handle_command_reply: tid=0 2024-09-19T08:43:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.108+0000 7f487564e740 1 client.14736 shutdown 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 msgr2=0x55a3f6aa36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6aa36a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f485c006010 tx=0x7f485c00bfa0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 shutdown_connections 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a3f6a99b40 0x55a3f6b06fd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "ed3de594-7661-11ef-bceb-c7b262605968", 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T08:43:33.143 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24497, 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 18.597298575, 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 17, 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 86, 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 28.849943417999999 2024-09-19T08:43:33.144 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a3f6a88fc0 0x55a3f6a9cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3f6a7a1f0 0x55a3f6a9c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4854ff9640 0 client.14736 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 --2- 172.21.15.18:0/3088637187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a3f6a798d0 0x55a3f6aa36a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 >> 172.21.15.18:0/3088637187 conn(0x55a3f6a75f60 msgr2=0x55a3f6a81240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 shutdown_connections 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 1 -- 172.21.15.18:0/3088637187 wait complete. 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f487564e740 20 client.14736 trim_cache size 0 max 16384 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48580a3240 msgr2=0x7f48580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48580a3240 0x7f48580a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f486406eb80 tx=0x7f48640c6b00 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 msgr2=0x7f486c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 0x7f486c19cce0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4864009fd0 tx=0x7f486400b260 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 shutdown_connections 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48580a3240 0x7f48580a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f486c106f00 0x7f486c19cce0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f486c102780 0x7f486c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 --2- 172.21.15.18:0/18604860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f486c101dd0 0x7f486c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 >> 172.21.15.18:0/18604860 conn(0x7f486c0fd890 msgr2=0x7f486c0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.109+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 shutdown_connections 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:33.110+0000 7f4873275640 1 -- 172.21.15.18:0/18604860 wait complete. 2024-09-19T08:43:33.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:33 smithi018 ceph-mon[30956]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:33.890 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:43:33.890 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:33.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T08:43:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:33 smithi162 ceph-mon[34870]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:33 smithi150 ceph-mon[34610]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:34.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 -- 172.21.15.18:0/144370453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 msgr2=0x7f7b14100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/144370453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b14100ee0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009930 tx=0x7f7b0802a420 comp rx=0 tx=0).stop 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 -- 172.21.15.18:0/144370453 shutdown_connections 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/144370453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 0x7f7b1410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/144370453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b14100ee0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/144370453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b14106a80 0x7f7b14106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.609+0000 7f7b19f5b640 1 -- 172.21.15.18:0/144370453 >> 172.21.15.18:0/144370453 conn(0x7f7b140fc7a0 msgr2=0x7f7b140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 -- 172.21.15.18:0/144370453 shutdown_connections 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 -- 172.21.15.18:0/144370453 wait complete. 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 Processor -- start 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 -- start start 2024-09-19T08:43:34.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b141993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 0x7f7b141998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.610+0000 7f7b19f5b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b14106a80 0x7f7b141a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b19f5b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14110dd0 con 0x7f7b14100a80 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b19f5b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14110c50 con 0x7f7b14106a80 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b19f5b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14110f50 con 0x7f7b14101420 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b141993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b141993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41004/0 (socket says 172.21.15.18:41004) 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 -- 172.21.15.18:0/163280464 learned_addr learned my addr 172.21.15.18:0/163280464 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b13fff640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b14106a80 0x7f7b141a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b12ffd640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 0x7f7b141998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 -- 172.21.15.18:0/163280464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 msgr2=0x7f7b141998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 0x7f7b141998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 -- 172.21.15.18:0/163280464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b14106a80 msgr2=0x7f7b141a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b14106a80 0x7f7b141a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 -- 172.21.15.18:0/163280464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b141a4960 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b12ffd640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 0x7f7b141998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b137fe640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b141993a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400b4a0 tx=0x7f7b0400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04014070 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b141a4b30 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b04010ac0 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04017c30 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.611+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b141a5070 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.613+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b14100f60 con 0x7f7b14100a80 2024-09-19T08:43:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.614+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7b04017070 con 0x7f7b14100a80 2024-09-19T08:43:34.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.614+0000 7f7b10ff9640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7afc0a3240 0x7f7afc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.614+0000 7f7b12ffd640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7afc0a3240 0x7f7afc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.615+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f7b040cf230 con 0x7f7b14100a80 2024-09-19T08:43:34.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.615+0000 7f7b12ffd640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7afc0a3240 0x7f7afc0a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b08031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:34.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.618+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b0409bdb0 con 0x7f7b14100a80 2024-09-19T08:43:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.830+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7b1402d7c0 con 0x7f7b14100a80 2024-09-19T08:43:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.830+0000 7f7b10ff9640 1 -- 172.21.15.18:0/163280464 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f7b0409b6b0 con 0x7f7b14100a80 2024-09-19T08:43:34.831 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:43:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7afc0a3240 msgr2=0x7f7afc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7afc0a3240 0x7f7afc0a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b08031400 comp rx=0 tx=0).stop 2024-09-19T08:43:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 msgr2=0x7f7b141993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b141993a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400b4a0 tx=0x7f7b0400b960 comp rx=0 tx=0).stop 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 shutdown_connections 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7afc0a3240 0x7f7afc0a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b14106a80 0x7f7b141a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14101420 0x7f7b141998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 --2- 172.21.15.18:0/163280464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b14100a80 0x7f7b141993a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 >> 172.21.15.18:0/163280464 conn(0x7f7b140fc7a0 msgr2=0x7f7b140fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 shutdown_connections 2024-09-19T08:43:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:34.833+0000 7f7b19f5b640 1 -- 172.21.15.18:0/163280464 wait complete. 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T08:43:35.649 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:43:35.650 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:43:35.650 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T08:43:35.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:35.650 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T08:43:35.668 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:43:35.668 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:43:35.668 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:43:35.668 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:43:35.668 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T08:43:35.669 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42213sec preferred_lft 42213sec 2024-09-19T08:43:35.670 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T08:43:35.670 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:43:35.670 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:43:35.670 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:43:35.670 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T08:43:35.671 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:43:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:43:35.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:35 smithi018 ceph-mon[30956]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:35.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:35 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/163280464' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:43:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:35.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:35.871 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:43:35.897 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T08:43:35.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:35.899 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T08:43:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:35 smithi162 ceph-mon[34870]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:35 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/163280464' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:43:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T08:43:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:43:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T08:43:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T08:43:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:43:35.975 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:43:35.975 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:43:35.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T08:43:35.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T08:43:35.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T08:43:35.975 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:43:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:43:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:35 smithi150 ceph-mon[34610]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:35 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/163280464' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:43:36.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:36.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:36.277 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T08:43:36.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:36.294 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-19T08:43:36.350 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:43:36.350 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:43:36.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:43:36.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T08:43:36.351 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:43:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:43:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:36.469 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T08:43:36.470 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:43:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:43:36.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:36.601 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:43:36.601 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:43:36.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T08:43:36.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:43:36.601 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:43:36.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:43:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:36.680 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T08:43:36.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:43:36.681 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:36.700 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T08:43:36.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:43:36.701 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:36.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-19T08:43:36.824 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-19T08:43:36.881 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:43:36.882 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/72dba623d3ade913a0fa1de30183490f8fe57b5240b0ced302064de5909316a8/merged 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/1ff47cfa4b9e875eecbe62abb5d473770baddd402796eafdc12106047286a555/merged 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/730222ea4c5f1f1953afdd2a6b4d54a5aef04625e8938a816fceeb748fc3d9ff/merged 2024-09-19T08:43:36.883 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/64b641414ff56b22c75132942f7b40fbf82cdc3cd6458fb1b2cc5d5a28ece127/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/da10f006617bc1e98f41fce0ed35af2090dfbb7b49d3a2b6f5dafa72fc0379d4/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9fba0f733ef426ec2f4ead4c349f0d402fcd35994e020839941126d78a802dcb/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8002d265c55365bb259ea1cec7ee717929c7f8a1f4212cafe9dc397636b617d/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/2d2a365bcd144639c8d26af9130356c09075e046f3d77d65a4ca01b420fee2ca/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/62f06939a10d24fc20de4496d7811beb90a3ebf99b55d6513164ea5fe2bf9a94/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/880bae033491acabca257ada6b19a22ba6a6bada30bdaf414b35fc2b6a4a0056/merged 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:43:36.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:36.885 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-19T08:43:36.937 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:43:36.937 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T08:43:36.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-19T08:43:37.005 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:43:37.064 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-19T08:43:37.064 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-19T08:43:37.064 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-19T08:43:37.064 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-19T08:43:37.064 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-19T08:43:37.064 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:43:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/72dba623d3ade913a0fa1de30183490f8fe57b5240b0ced302064de5909316a8/merged 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/1ff47cfa4b9e875eecbe62abb5d473770baddd402796eafdc12106047286a555/merged 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/730222ea4c5f1f1953afdd2a6b4d54a5aef04625e8938a816fceeb748fc3d9ff/merged 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/64b641414ff56b22c75132942f7b40fbf82cdc3cd6458fb1b2cc5d5a28ece127/merged 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/da10f006617bc1e98f41fce0ed35af2090dfbb7b49d3a2b6f5dafa72fc0379d4/merged 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9fba0f733ef426ec2f4ead4c349f0d402fcd35994e020839941126d78a802dcb/merged 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8002d265c55365bb259ea1cec7ee717929c7f8a1f4212cafe9dc397636b617d/merged 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/2d2a365bcd144639c8d26af9130356c09075e046f3d77d65a4ca01b420fee2ca/merged 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/62f06939a10d24fc20de4496d7811beb90a3ebf99b55d6513164ea5fe2bf9a94/merged 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/880bae033491acabca257ada6b19a22ba6a6bada30bdaf414b35fc2b6a4a0056/merged 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:43:37.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:37.067 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-19T08:43:37.089 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2024-09-19T08:43:37.089+0000 7f6727017480 -1 init, newargv = 0x55d644f15900 newargc=15 2024-09-19T08:43:37.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74643]: starting ceph client 2024-09-19T08:43:37.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74643]: starting fuse 2024-09-19T08:43:37.106 INFO:teuthology.orchestra.run.smithi018.stdout:96 2024-09-19T08:43:37.106 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [96] 2024-09-19T08:43:37.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:43:37.106 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-09-19T08:43:37.106 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-09-19T08:43:37.106 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:43:37.107 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2024-09-19T08:43:37.108 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T08:43:37.228 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.74643.asok 2024-09-19T08:43:37.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:37.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74643.asok 2024-09-19T08:43:37.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:37.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74643.asok status 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "74643", 2024-09-19T08:43:37.379 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 14748, 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 14748 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1054332672 2024-09-19T08:43:37.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1054332672 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.14748 192.168.0.1:0/1054332672", 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/1054332672", 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 17, 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 86, 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:43:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-09-19T08:43:37.382 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-09-19T08:43:37.382 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:43:37.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:37.388 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-09-19T08:43:37.388 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:37.404 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-09-19T08:43:37.405 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:37.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:37.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:37.473 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T08:43:37.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:43:37.581 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2024-09-19T08:43:37.582 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T08:43:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:43:37.588 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:43:37.588 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:43:37.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:43:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:37 smithi162 ceph-mon[34870]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:37.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:37 smithi018 ceph-mon[30956]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:37 smithi150 ceph-mon[34610]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 -- 172.21.15.18:0/1253850792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3341034d0 msgr2=0x7fb33410b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 --2- 172.21.15.18:0/1253850792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3341034d0 0x7fb33410b9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb328009900 tx=0x7fb32802a480 comp rx=0 tx=0).stop 2024-09-19T08:43:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 -- 172.21.15.18:0/1253850792 shutdown_connections 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 --2- 172.21.15.18:0/1253850792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb33410bfe0 0x7fb33410e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 --2- 172.21.15.18:0/1253850792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3341034d0 0x7fb33410b9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 --2- 172.21.15.18:0/1253850792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb334102bb0 0x7fb334102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 -- 172.21.15.18:0/1253850792 >> 172.21.15.18:0/1253850792 conn(0x7fb3340fc630 msgr2=0x7fb3340fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 -- 172.21.15.18:0/1253850792 shutdown_connections 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.470+0000 7fb339804640 1 -- 172.21.15.18:0/1253850792 wait complete. 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 Processor -- start 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 -- start start 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb334102bb0 0x7fb33419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3341034d0 0x7fb33419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 0x7fb33419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb334111c90 con 0x7fb33410bfe0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb334111b10 con 0x7fb334102bb0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb339804640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb334111e10 con 0x7fb3341034d0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb3337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 0x7fb33419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb3337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 0x7fb33419ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41024/0 (socket says 172.21.15.18:41024) 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.471+0000 7fb3337fe640 1 -- 172.21.15.18:0/2876721335 learned_addr learned my addr 172.21.15.18:0/2876721335 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb332ffd640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb334102bb0 0x7fb33419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb3337fe640 1 -- 172.21.15.18:0/2876721335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3341034d0 msgr2=0x7fb33419a9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb3337fe640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3341034d0 0x7fb33419a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb3337fe640 1 -- 172.21.15.18:0/2876721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb334102bb0 msgr2=0x7fb33419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb3337fe640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb334102bb0 0x7fb33419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb3337fe640 1 -- 172.21.15.18:0/2876721335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33419f3a0 con 0x7fb33410bfe0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb3337fe640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 0x7fb33419ecc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00eb10 tx=0x7fb32c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c004b20 con 0x7fb33410bfe0 2024-09-19T08:43:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb32c004cc0 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c010690 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33419f690 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.472+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3341a6f70 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.473+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb334102f90 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.474+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb32c005020 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.475+0000 7fb338802640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb31c0a32c0 0x7fb31c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.475+0000 7fb332ffd640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb31c0a32c0 0x7fb31c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.475+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fb32c0d01b0 con 0x7fb33410bfe0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.476+0000 7fb332ffd640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb31c0a32c0 0x7fb31c0a5780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb324009b60 tx=0x7fb324005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.480+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb32c09cc30 con 0x7fb33410bfe0 2024-09-19T08:43:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.667+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb334104b10 con 0x7fb33410bfe0 2024-09-19T08:43:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.667+0000 7fb338802640 1 -- 172.21.15.18:0/2876721335 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+591 (secure 0 0 0) 0x7fb32c09c530 con 0x7fb33410bfe0 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2071748034 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2416383067 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2457973928 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4200011478 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:38.668 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/338127021 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:38.669 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:38.669 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:38.669 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3236542074 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb31c0a32c0 msgr2=0x7fb31c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb31c0a32c0 0x7fb31c0a5780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb324009b60 tx=0x7fb324005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 msgr2=0x7fb33419ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 0x7fb33419ecc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00eb10 tx=0x7fb32c00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 shutdown_connections 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb31c0a32c0 0x7fb31c0a5780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb33410bfe0 0x7fb33419ecc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3341034d0 0x7fb33419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 --2- 172.21.15.18:0/2876721335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb334102bb0 0x7fb33419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.669+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 >> 172.21.15.18:0/2876721335 conn(0x7fb3340fc630 msgr2=0x7fb334101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:38.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.670+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 shutdown_connections 2024-09-19T08:43:38.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:38.670+0000 7fb339804640 1 -- 172.21.15.18:0/2876721335 wait complete. 2024-09-19T08:43:39.375 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:43:39.376 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:43:39.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:43:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:39.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:39 smithi018 ceph-mon[30956]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:39.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:39 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2876721335' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:43:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:39 smithi162 ceph-mon[34870]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:39 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2876721335' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:43:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:39 smithi150 ceph-mon[34610]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:39 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2876721335' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 -- 172.21.15.18:0/1623222662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130101420 msgr2=0x7fe13010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 --2- 172.21.15.18:0/1623222662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130101420 0x7fe13010d950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe128009cd0 tx=0x7fe12802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 -- 172.21.15.18:0/1623222662 shutdown_connections 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 --2- 172.21.15.18:0/1623222662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130101420 0x7fe13010d950 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 --2- 172.21.15.18:0/1623222662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130100a80 0x7fe130100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 --2- 172.21.15.18:0/1623222662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe130106a80 0x7fe130106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 -- 172.21.15.18:0/1623222662 >> 172.21.15.18:0/1623222662 conn(0x7fe1300fc7a0 msgr2=0x7fe1300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 -- 172.21.15.18:0/1623222662 shutdown_connections 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.175+0000 7fe1381be640 1 -- 172.21.15.18:0/1623222662 wait complete. 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 Processor -- start 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 -- start start 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe130100a80 0x7fe1300fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101420 0x7fe1300fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 0x7fe1300fd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe130110dd0 con 0x7fe130106a80 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe130110c50 con 0x7fe130101420 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe1381be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe130110f50 con 0x7fe130100a80 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe13675b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 0x7fe1300fd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe13675b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 0x7fe1300fd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60114/0 (socket says 172.21.15.18:60114) 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe13675b640 1 -- 172.21.15.18:0/2680002804 learned_addr learned my addr 172.21.15.18:0/2680002804 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe135f5a640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe130100a80 0x7fe1300fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.176+0000 7fe135759640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101420 0x7fe1300fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe13675b640 1 -- 172.21.15.18:0/2680002804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe130100a80 msgr2=0x7fe1300fcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe13675b640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe130100a80 0x7fe1300fcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe13675b640 1 -- 172.21.15.18:0/2680002804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101420 msgr2=0x7fe1300fd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe13675b640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101420 0x7fe1300fd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe13675b640 1 -- 172.21.15.18:0/2680002804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1301a6950 con 0x7fe130106a80 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe135759640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101420 0x7fe1300fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe13675b640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 0x7fe1300fd920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe128005cc0 tx=0x7fe128003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128004240 con 0x7fe130106a80 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1280305a0 con 0x7fe130106a80 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1301a6be0 con 0x7fe130106a80 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280466c0 con 0x7fe130106a80 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.177+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1301a7170 con 0x7fe130106a80 2024-09-19T08:43:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.178+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe130100f60 con 0x7fe130106a80 2024-09-19T08:43:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.179+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe128030ac0 con 0x7fe130106a80 2024-09-19T08:43:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.180+0000 7fe126ffd640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe11c0a32c0 0x7fe11c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.180+0000 7fe135f5a640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe11c0a32c0 0x7fe11c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.180+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fe12802e030 con 0x7fe130106a80 2024-09-19T08:43:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.180+0000 7fe135f5a640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe11c0a32c0 0x7fe11c0a5780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009990 tx=0x7fe12c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.184+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe12804b060 con 0x7fe130106a80 2024-09-19T08:43:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.370+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe13010a020 con 0x7fe130106a80 2024-09-19T08:43:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.371+0000 7fe126ffd640 1 -- 172.21.15.18:0/2680002804 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+591 (secure 0 0 0) 0x7fe1280bd320 con 0x7fe130106a80 2024-09-19T08:43:40.371 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2071748034 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:40.371 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2416383067 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:40.371 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:40.371 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2457973928 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4200011478 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/338127021 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3236542074 2024-09-20T08:35:53.066097+0000 2024-09-19T08:43:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe11c0a32c0 msgr2=0x7fe11c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe11c0a32c0 0x7fe11c0a5780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009990 tx=0x7fe12c009110 comp rx=0 tx=0).stop 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 msgr2=0x7fe1300fd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 0x7fe1300fd920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe128005cc0 tx=0x7fe128003ba0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 shutdown_connections 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe11c0a32c0 0x7fe11c0a5780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe130106a80 0x7fe1300fd920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101420 0x7fe1300fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 --2- 172.21.15.18:0/2680002804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe130100a80 0x7fe1300fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 >> 172.21.15.18:0/2680002804 conn(0x7fe1300fc7a0 msgr2=0x7fe13006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 shutdown_connections 2024-09-19T08:43:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:40.373+0000 7fe1381be640 1 -- 172.21.15.18:0/2680002804 wait complete. 2024-09-19T08:43:40.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:40 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2680002804' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:43:40.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:40 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2680002804' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:43:40.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:40 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2680002804' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:43:41.134 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-09-19T08:43:41.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:41.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:43:41.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74643]: fuse finished with error 0 and tester_r 0 2024-09-19T08:43:41.166 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:43:41.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:41 smithi162 ceph-mon[34870]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:41.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:41 smithi018 ceph-mon[30956]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:41 smithi150 ceph-mon[34610]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:43 smithi162 ceph-mon[34870]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:43.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:43 smithi018 ceph-mon[30956]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:43 smithi150 ceph-mon[34610]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:45.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:45 smithi018 ceph-mon[30956]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:45.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:45 smithi162 ceph-mon[34870]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:46.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:45 smithi150 ceph-mon[34610]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:47.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:43:47.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:43:47.268 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T08:43:47.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:47.607 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:47.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:47 smithi018 ceph-mon[30956]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:47 smithi162 ceph-mon[34870]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:47 smithi150 ceph-mon[34610]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:48.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 -- 172.21.15.18:0/2443499506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8201027c0 msgr2=0x7fe820106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:48.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2443499506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8201027c0 0x7fe820106810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe814009900 tx=0x7fe81402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:48.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 -- 172.21.15.18:0/2443499506 shutdown_connections 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2443499506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe820106f40 0x7fe82010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2443499506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8201027c0 0x7fe820106810 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2443499506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe820101e10 0x7fe8201021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 -- 172.21.15.18:0/2443499506 >> 172.21.15.18:0/2443499506 conn(0x7fe8200fd8d0 msgr2=0x7fe8200ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 -- 172.21.15.18:0/2443499506 shutdown_connections 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 -- 172.21.15.18:0/2443499506 wait complete. 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 Processor -- start 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.081+0000 7fe8274c1640 1 -- start start 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe8274c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe820101e10 0x7fe8200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe8274c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8201027c0 0x7fe820074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe8274c1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 0x7fe820074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe8274c1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe820111ef0 con 0x7fe820106f40 2024-09-19T08:43:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe8274c1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe820111d70 con 0x7fe820101e10 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe8274c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe820112070 con 0x7fe8201027c0 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 0x7fe820074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 0x7fe820074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60132/0 (socket says 172.21.15.18:60132) 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 -- 172.21.15.18:0/2058322938 learned_addr learned my addr 172.21.15.18:0/2058322938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe824a5c640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8201027c0 0x7fe820074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 -- 172.21.15.18:0/2058322938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8201027c0 msgr2=0x7fe820074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8201027c0 0x7fe820074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 -- 172.21.15.18:0/2058322938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe820101e10 msgr2=0x7fe8200744f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe820101e10 0x7fe8200744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 -- 172.21.15.18:0/2058322938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201a69d0 con 0x7fe820106f40 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe825a5e640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 0x7fe820074f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe818009fd0 tx=0x7fe81800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.082+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818011830 con 0x7fe820106f40 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.083+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe818016070 con 0x7fe820106f40 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.083+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201a6cc0 con 0x7fe820106f40 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.083+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818010de0 con 0x7fe820106f40 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.083+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201a7180 con 0x7fe820106f40 2024-09-19T08:43:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.084+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe820102270 con 0x7fe820106f40 2024-09-19T08:43:48.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.086+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe8180119d0 con 0x7fe820106f40 2024-09-19T08:43:48.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.086+0000 7fe81e7fc640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe8080a3240 0x7fe8080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:48.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.087+0000 7fe82525d640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe8080a3240 0x7fe8080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:48.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.087+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fe8180cf940 con 0x7fe820106f40 2024-09-19T08:43:48.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.087+0000 7fe82525d640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe8080a3240 0x7fe8080a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ab90 tx=0x7fe810009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:48.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.090+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe81809c420 con 0x7fe820106f40 2024-09-19T08:43:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.271+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe820075a20 con 0x7fe820106f40 2024-09-19T08:43:48.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.273+0000 7fe81e7fc640 1 -- 172.21.15.18:0/2058322938 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7fe820075a20 con 0x7fe820106f40 2024-09-19T08:43:48.273 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:48.274 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe8080a3240 msgr2=0x7fe8080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe8080a3240 0x7fe8080a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ab90 tx=0x7fe810009250 comp rx=0 tx=0).stop 2024-09-19T08:43:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 msgr2=0x7fe820074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 0x7fe820074f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe818009fd0 tx=0x7fe81800b8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 shutdown_connections 2024-09-19T08:43:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe8080a3240 0x7fe8080a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe820106f40 0x7fe820074f70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8201027c0 0x7fe820074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 --2- 172.21.15.18:0/2058322938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe820101e10 0x7fe8200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 >> 172.21.15.18:0/2058322938 conn(0x7fe8200fd8d0 msgr2=0x7fe8200fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 shutdown_connections 2024-09-19T08:43:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:48.276+0000 7fe8274c1640 1 -- 172.21.15.18:0/2058322938 wait complete. 2024-09-19T08:43:48.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:48 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2058322938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:48.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:48 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2058322938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:49.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:48 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2058322938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:49.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:49.814 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:49 smithi018 ceph-mon[30956]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 -- 172.21.15.18:0/4061719936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470101de0 msgr2=0x7f44701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 --2- 172.21.15.18:0/4061719936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470101de0 0x7f44701021c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f446c009900 tx=0x7f446c02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 -- 172.21.15.18:0/4061719936 shutdown_connections 2024-09-19T08:43:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 --2- 172.21.15.18:0/4061719936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4470106f10 0x7f447010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 --2- 172.21.15.18:0/4061719936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4470102790 0x7f44701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 --2- 172.21.15.18:0/4061719936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470101de0 0x7f44701021c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 -- 172.21.15.18:0/4061719936 >> 172.21.15.18:0/4061719936 conn(0x7f44700fd8c0 msgr2=0x7f44700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 -- 172.21.15.18:0/4061719936 shutdown_connections 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.896+0000 7f44787e1640 1 -- 172.21.15.18:0/4061719936 wait complete. 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 Processor -- start 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 -- start start 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4470101de0 0x7f447019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4470102790 0x7f447019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 0x7f447019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4470111e20 con 0x7f4470106f10 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4470111ca0 con 0x7f4470101de0 2024-09-19T08:43:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f44787e1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4470111fa0 con 0x7f4470102790 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 0x7f447019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 0x7f447019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54136/0 (socket says 172.21.15.18:54136) 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 -- 172.21.15.18:0/1536056645 learned_addr learned my addr 172.21.15.18:0/1536056645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f447657d640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4470101de0 0x7f447019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4475d7c640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4470102790 0x7f447019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 -- 172.21.15.18:0/1536056645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4470102790 msgr2=0x7f447019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4470102790 0x7f447019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 -- 172.21.15.18:0/1536056645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4470101de0 msgr2=0x7f447019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4470101de0 0x7f447019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.897+0000 7f4476d7e640 1 -- 172.21.15.18:0/1536056645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447019f550 con 0x7f4470106f10 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.898+0000 7f4476d7e640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 0x7f447019ee70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f446800eaa0 tx=0x7f446800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.898+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446800cdb0 con 0x7f4470106f10 2024-09-19T08:43:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.898+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4468005020 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.898+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447019f840 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.898+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44680116d0 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.898+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44701a7120 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.899+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44701021c0 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.900+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f44680051d0 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.901+0000 7f44677fe640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f445c0a32c0 0x7f445c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.901+0000 7f447657d640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f445c0a32c0 0x7f445c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.901+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f44680cfda0 con 0x7f4470106f10 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.901+0000 7f447657d640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f445c0a32c0 0x7f445c0a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f446c031440 tx=0x7f446c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:49.905+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4468016030 con 0x7f4470106f10 2024-09-19T08:43:49.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:49 smithi162 ceph-mon[34870]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:50.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:49 smithi150 ceph-mon[34610]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:50.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.081+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44701a7400 con 0x7f4470106f10 2024-09-19T08:43:50.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.083+0000 7f44677fe640 1 -- 172.21.15.18:0/1536056645 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7f446809c820 con 0x7f4470106f10 2024-09-19T08:43:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:43:50.084 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:50.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f445c0a32c0 msgr2=0x7f445c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f445c0a32c0 0x7f445c0a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f446c031440 tx=0x7f446c0095f0 comp rx=0 tx=0).stop 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 msgr2=0x7f447019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 0x7f447019ee70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f446800eaa0 tx=0x7f446800ef60 comp rx=0 tx=0).stop 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 shutdown_connections 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f445c0a32c0 0x7f445c0a5780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4470106f10 0x7f447019ee70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4470102790 0x7f447019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 --2- 172.21.15.18:0/1536056645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4470101de0 0x7f447019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 >> 172.21.15.18:0/1536056645 conn(0x7f44700fd8c0 msgr2=0x7f44700fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:50.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 shutdown_connections 2024-09-19T08:43:50.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:50.085+0000 7f44787e1640 1 -- 172.21.15.18:0/1536056645 wait complete. 2024-09-19T08:43:50.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1536056645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:50.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:50 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1536056645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:50.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:43:51.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:50 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1536056645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 -- 172.21.15.18:0/2831111235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458101de0 msgr2=0x7f04581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 --2- 172.21.15.18:0/2831111235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458101de0 0x7f04581021c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0454009900 tx=0x7f045402a440 comp rx=0 tx=0).stop 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 -- 172.21.15.18:0/2831111235 shutdown_connections 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 --2- 172.21.15.18:0/2831111235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0458106f10 0x7f045810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 --2- 172.21.15.18:0/2831111235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 0x7f04581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 --2- 172.21.15.18:0/2831111235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458101de0 0x7f04581021c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 -- 172.21.15.18:0/2831111235 >> 172.21.15.18:0/2831111235 conn(0x7f04580fd8c0 msgr2=0x7f04580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:51.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 -- 172.21.15.18:0/2831111235 shutdown_connections 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.659+0000 7f045fee0640 1 -- 172.21.15.18:0/2831111235 wait complete. 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 Processor -- start 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 -- start start 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0458101de0 0x7f04580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 0x7f0458074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 0x7f0458074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0458111f00 con 0x7f0458106f10 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0458111d80 con 0x7f0458101de0 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045fee0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0458112080 con 0x7f0458102790 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045e47d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 0x7f0458074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045e47d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 0x7f0458074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54162/0 (socket says 172.21.15.18:54162) 2024-09-19T08:43:51.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.660+0000 7f045e47d640 1 -- 172.21.15.18:0/1294752628 learned_addr learned my addr 172.21.15.18:0/1294752628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045d47b640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 0x7f0458074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045e47d640 1 -- 172.21.15.18:0/1294752628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 msgr2=0x7f0458074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045e47d640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 0x7f0458074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045e47d640 1 -- 172.21.15.18:0/1294752628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0458101de0 msgr2=0x7f04580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045e47d640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0458101de0 0x7f04580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045e47d640 1 -- 172.21.15.18:0/1294752628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04581a6a90 con 0x7f0458106f10 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045d47b640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 0x7f0458074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045e47d640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 0x7f0458074f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f045000b990 tx=0x7f045000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450019070 con 0x7f0458106f10 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04581a6d80 con 0x7f0458106f10 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f045000cba0 con 0x7f0458106f10 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500075d0 con 0x7f0458106f10 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.661+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04581a7210 con 0x7f0458106f10 2024-09-19T08:43:51.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.662+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0458102240 con 0x7f0458106f10 2024-09-19T08:43:51.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.663+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f045001c070 con 0x7f0458106f10 2024-09-19T08:43:51.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.664+0000 7f044effd640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04440a3240 0x7f04440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.664+0000 7f045dc7c640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04440a3240 0x7f04440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.664+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f04500cf280 con 0x7f0458106f10 2024-09-19T08:43:51.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.665+0000 7f045dc7c640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04440a3240 0x7f04440a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f04540096c0 tx=0x7f0454031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:51.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.669+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f045009bd00 con 0x7f0458106f10 2024-09-19T08:43:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:51.881+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0458109b60 con 0x7f0458106f10 2024-09-19T08:43:51.882 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:51 smithi018 ceph-mon[30956]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:51 smithi162 ceph-mon[34870]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:52.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:51 smithi150 ceph-mon[34610]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.618+0000 7f044effd640 1 -- 172.21.15.18:0/1294752628 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f045009b600 con 0x7f0458106f10 2024-09-19T08:43:52.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04440a3240 msgr2=0x7f04440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:52.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04440a3240 0x7f04440a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f04540096c0 tx=0x7f0454031400 comp rx=0 tx=0).stop 2024-09-19T08:43:52.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 msgr2=0x7f0458074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 0x7f0458074f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f045000b990 tx=0x7f045000be50 comp rx=0 tx=0).stop 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 shutdown_connections 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f04440a3240 0x7f04440a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0458106f10 0x7f0458074f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0458102790 0x7f0458074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 --2- 172.21.15.18:0/1294752628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0458101de0 0x7f04580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 >> 172.21.15.18:0/1294752628 conn(0x7f04580fd8c0 msgr2=0x7f04580fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 shutdown_connections 2024-09-19T08:43:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:52.621+0000 7f045fee0640 1 -- 172.21.15.18:0/1294752628 wait complete. 2024-09-19T08:43:52.877 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:52 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1294752628' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:43:52.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:52 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1294752628' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:43:53.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:52 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1294752628' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:43:53.426 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T08:43:53.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T08:43:53.691 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:53.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:53 smithi018 ceph-mon[30956]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:53.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:53 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1294752628' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:43:53.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:53 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:53.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:53 smithi162 ceph-mon[34870]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:53.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:53 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1294752628' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:43:53.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:53 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:53 smithi150 ceph-mon[34610]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T08:43:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:53 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1294752628' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:43:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:53 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 -- 172.21.15.18:0/1964227340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830102790 msgr2=0x7f78301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 --2- 172.21.15.18:0/1964227340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830102790 0x7f78301067e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7824009900 tx=0x7f782402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 -- 172.21.15.18:0/1964227340 shutdown_connections 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 --2- 172.21.15.18:0/1964227340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7830106f10 0x7f783010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 --2- 172.21.15.18:0/1964227340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830102790 0x7f78301067e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 --2- 172.21.15.18:0/1964227340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7830101de0 0x7f78301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 -- 172.21.15.18:0/1964227340 >> 172.21.15.18:0/1964227340 conn(0x7f78300fd8c0 msgr2=0x7f78300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 -- 172.21.15.18:0/1964227340 shutdown_connections 2024-09-19T08:43:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.189+0000 7f7835c32640 1 -- 172.21.15.18:0/1964227340 wait complete. 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 Processor -- start 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 -- start start 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7830101de0 0x7f78300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7830102790 0x7f7830074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 0x7f7830074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7830111e20 con 0x7f7830106f10 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7830111ca0 con 0x7f7830102790 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f7835c32640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7830111fa0 con 0x7f7830101de0 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f782ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 0x7f7830074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f782ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 0x7f7830074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54180/0 (socket says 172.21.15.18:54180) 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f782ffff640 1 -- 172.21.15.18:0/1107498466 learned_addr learned my addr 172.21.15.18:0/1107498466 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f782effd640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7830102790 0x7f7830074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.190+0000 7f782f7fe640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7830101de0 0x7f78300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782ffff640 1 -- 172.21.15.18:0/1107498466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7830101de0 msgr2=0x7f78300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782ffff640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7830101de0 0x7f78300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782ffff640 1 -- 172.21.15.18:0/1107498466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7830102790 msgr2=0x7f7830074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782ffff640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7830102790 0x7f7830074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782ffff640 1 -- 172.21.15.18:0/1107498466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78301a6880 con 0x7f7830106f10 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782ffff640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 0x7f7830074f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f782800c970 tx=0x7f782800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828007bb0 con 0x7f7830106f10 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78301a6b70 con 0x7f7830106f10 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7828007d50 con 0x7f7830106f10 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828004e10 con 0x7f7830106f10 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.191+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78301a7030 con 0x7f7830106f10 2024-09-19T08:43:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.192+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78301021c0 con 0x7f7830106f10 2024-09-19T08:43:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.193+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7828005020 con 0x7f7830106f10 2024-09-19T08:43:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.194+0000 7f782cff9640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78180a3240 0x7f78180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.194+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f78280cf770 con 0x7f7830106f10 2024-09-19T08:43:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.194+0000 7f782f7fe640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78180a3240 0x7f78180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.195+0000 7f782f7fe640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78180a3240 0x7f78180a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7820005fd0 tx=0x7f7820009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.198+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7828014030 con 0x7f7830106f10 2024-09-19T08:43:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.411+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f783010a150 con 0x7f7830106f10 2024-09-19T08:43:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.625+0000 7f782cff9640 1 -- 172.21.15.18:0/1107498466 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f782809bba0 con 0x7f7830106f10 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78180a3240 msgr2=0x7f78180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78180a3240 0x7f78180a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7820005fd0 tx=0x7f7820009680 comp rx=0 tx=0).stop 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 msgr2=0x7f7830074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 0x7f7830074f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f782800c970 tx=0x7f782800ce30 comp rx=0 tx=0).stop 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 shutdown_connections 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f78180a3240 0x7f78180a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7830106f10 0x7f7830074f70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7830102790 0x7f7830074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 --2- 172.21.15.18:0/1107498466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7830101de0 0x7f78300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.627+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 >> 172.21.15.18:0/1107498466 conn(0x7f78300fd8c0 msgr2=0x7f78300fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.628+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 shutdown_connections 2024-09-19T08:43:54.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:54.628+0000 7f7835c32640 1 -- 172.21.15.18:0/1107498466 wait complete. 2024-09-19T08:43:54.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:54 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1107498466' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:43:54.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:54 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1107498466' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:43:55.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:54 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1107498466' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:43:55.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T08:43:55.675 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:55.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:55 smithi018 ceph-mon[30956]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:55.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:55 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1107498466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:43:55.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:55 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:55.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:55 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:43:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:55 smithi162 ceph-mon[34870]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:55 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1107498466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:43:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:55 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:55 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:43:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:55 smithi150 ceph-mon[34610]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:43:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:55 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1107498466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:43:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:55 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:43:56.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:55 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:43:56.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 -- 172.21.15.18:0/703195840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 msgr2=0x7f0e1c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 --2- 172.21.15.18:0/703195840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c10ea90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009ca0 tx=0x7f0e1402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 -- 172.21.15.18:0/703195840 shutdown_connections 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 --2- 172.21.15.18:0/703195840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c10ea90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 --2- 172.21.15.18:0/703195840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c102790 0x7f0e1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 --2- 172.21.15.18:0/703195840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c101de0 0x7f0e1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 -- 172.21.15.18:0/703195840 >> 172.21.15.18:0/703195840 conn(0x7f0e1c0fd8c0 msgr2=0x7f0e1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 -- 172.21.15.18:0/703195840 shutdown_connections 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.132+0000 7f0e22368640 1 -- 172.21.15.18:0/703195840 wait complete. 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 Processor -- start 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 -- start start 2024-09-19T08:43:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c101de0 0x7f0e1c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c102790 0x7f0e1c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c111e20 con 0x7f0e1c106f10 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c111ca0 con 0x7f0e1c102790 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e22368640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c111fa0 con 0x7f0e1c101de0 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e20905640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e20905640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54194/0 (socket says 172.21.15.18:54194) 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e20905640 1 -- 172.21.15.18:0/1440816625 learned_addr learned my addr 172.21.15.18:0/1440816625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.133+0000 7f0e1bfff640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c101de0 0x7f0e1c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e1b7fe640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c102790 0x7f0e1c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e20905640 1 -- 172.21.15.18:0/1440816625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c101de0 msgr2=0x7f0e1c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e20905640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c101de0 0x7f0e1c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e20905640 1 -- 172.21.15.18:0/1440816625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c102790 msgr2=0x7f0e1c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e20905640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c102790 0x7f0e1c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e20905640 1 -- 172.21.15.18:0/1440816625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c19d2b0 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e20905640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c19cbd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009dc0 tx=0x7f0e14032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14003cf0 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e140044f0 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c19d540 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14030bf0 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.134+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c1a4e80 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.135+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c1021c0 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.136+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0e14004040 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.137+0000 7f0e197fa640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0e040a3240 0x7f0e040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.137+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f0e140f11b0 con 0x7f0e1c106f10 2024-09-19T08:43:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.137+0000 7f0e1bfff640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0e040a3240 0x7f0e040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.138+0000 7f0e1bfff640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0e040a3240 0x7f0e040a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c005d00 tx=0x7f0e0c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.141+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e140bdc90 con 0x7f0e1c106f10 2024-09-19T08:43:56.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.356+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0e1c10a150 con 0x7f0e1c106f10 2024-09-19T08:43:56.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.632+0000 7f0e197fa640 1 -- 172.21.15.18:0/1440816625 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f0e140bd590 con 0x7f0e1c106f10 2024-09-19T08:43:56.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0e040a3240 msgr2=0x7f0e040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0e040a3240 0x7f0e040a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c005d00 tx=0x7f0e0c00b410 comp rx=0 tx=0).stop 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 msgr2=0x7f0e1c19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c19cbd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009dc0 tx=0x7f0e14032ff0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 shutdown_connections 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0e040a3240 0x7f0e040a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e1c106f10 0x7f0e1c19cbd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c102790 0x7f0e1c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 --2- 172.21.15.18:0/1440816625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e1c101de0 0x7f0e1c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 >> 172.21.15.18:0/1440816625 conn(0x7f0e1c0fd8c0 msgr2=0x7f0e1c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 shutdown_connections 2024-09-19T08:43:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:56.634+0000 7f0e22368640 1 -- 172.21.15.18:0/1440816625 wait complete. 2024-09-19T08:43:56.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:56 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1440816625' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:43:56.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:56 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1440816625' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:43:57.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:56 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1440816625' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:43:57.546 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T08:43:57.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T08:43:57.809 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:57.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:57 smithi162 ceph-mon[34870]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 0 op/s 2024-09-19T08:43:57.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:57 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1440816625' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:43:57.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:57 smithi162 ceph-mon[34870]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:43:57.930 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:57 smithi018 ceph-mon[30956]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 0 op/s 2024-09-19T08:43:57.930 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1440816625' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:43:57.930 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:57 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:43:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:57 smithi150 ceph-mon[34610]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 0 op/s 2024-09-19T08:43:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:57 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1440816625' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:43:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:57 smithi150 ceph-mon[34610]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:43:58.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.277+0000 7f8ed9d43640 1 -- 172.21.15.18:0/627086064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed410c170 msgr2=0x7f8ed410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:58.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.277+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/627086064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed410c170 0x7f8ed410e610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009ca0 tx=0x7f8ecc02a950 comp rx=0 tx=0).stop 2024-09-19T08:43:58.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.277+0000 7f8ed9d43640 1 -- 172.21.15.18:0/627086064 shutdown_connections 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.277+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/627086064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed410c170 0x7f8ed410e610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/627086064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4103660 0x7f8ed410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/627086064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ed4102d40 0x7f8ed4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 -- 172.21.15.18:0/627086064 >> 172.21.15.18:0/627086064 conn(0x7f8ed40fc7a0 msgr2=0x7f8ed40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 -- 172.21.15.18:0/627086064 shutdown_connections 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 -- 172.21.15.18:0/627086064 wait complete. 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 Processor -- start 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.278+0000 7f8ed9d43640 1 -- start start 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed9d43640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4102d40 0x7f8ed4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed9d43640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 0x7f8ed4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed9d43640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ed410c170 0x7f8ed419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed9d43640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4111e20 con 0x7f8ed4103660 2024-09-19T08:43:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed9d43640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4111ca0 con 0x7f8ed4102d40 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed9d43640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4111fa0 con 0x7f8ed410c170 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 0x7f8ed4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 0x7f8ed4198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54208/0 (socket says 172.21.15.18:54208) 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 -- 172.21.15.18:0/4078293270 learned_addr learned my addr 172.21.15.18:0/4078293270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed37fe640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4102d40 0x7f8ed4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed3fff640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ed410c170 0x7f8ed419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 -- 172.21.15.18:0/4078293270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ed410c170 msgr2=0x7f8ed419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ed410c170 0x7f8ed419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 -- 172.21.15.18:0/4078293270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4102d40 msgr2=0x7f8ed4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4102d40 0x7f8ed4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 -- 172.21.15.18:0/4078293270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed419d2b0 con 0x7f8ed4103660 2024-09-19T08:43:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed2ffd640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 0x7f8ed4198840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800d740 tx=0x7f8ec800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.279+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8017070 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.280+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ec800de50 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.280+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed419d5a0 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.280+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800f620 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.280+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed41a4e80 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.281+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed4103120 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.282+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8ec8009c30 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.282+0000 7f8ed0ff9640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8ebc0a32c0 0x7f8ebc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.283+0000 7f8ed37fe640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8ebc0a32c0 0x7f8ebc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.283+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f8ec80cf660 con 0x7f8ed4103660 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.283+0000 7f8ed37fe640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8ebc0a32c0 0x7f8ebc0a5780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4005fd0 tx=0x7f8ec400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.287+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ec809c140 con 0x7f8ed4103660 2024-09-19T08:43:58.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.489+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8ed4062630 con 0x7f8ebc0a32c0 2024-09-19T08:43:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.508+0000 7f8ed0ff9640 1 -- 172.21.15.18:0/4078293270 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8ed4062630 con 0x7f8ebc0a32c0 2024-09-19T08:43:58.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8ebc0a32c0 msgr2=0x7f8ebc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:58.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8ebc0a32c0 0x7f8ebc0a5780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4005fd0 tx=0x7f8ec400b390 comp rx=0 tx=0).stop 2024-09-19T08:43:58.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 msgr2=0x7f8ed4198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:58.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 0x7f8ed4198840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800d740 tx=0x7f8ec800dc00 comp rx=0 tx=0).stop 2024-09-19T08:43:58.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 shutdown_connections 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8ebc0a32c0 0x7f8ebc0a5780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ed410c170 0x7f8ed419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed4103660 0x7f8ed4198840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 --2- 172.21.15.18:0/4078293270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4102d40 0x7f8ed4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 >> 172.21.15.18:0/4078293270 conn(0x7f8ed40fc7a0 msgr2=0x7f8ed40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 shutdown_connections 2024-09-19T08:43:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:58.511+0000 7f8ed9d43640 1 -- 172.21.15.18:0/4078293270 wait complete. 2024-09-19T08:43:58.898 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:43:58 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:43:58.494+0000 7fd9c1e1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:43:58.898 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:43:58 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:43:58.494+0000 7fd9c1e1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:43:58.898 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:43:58 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:43:58.494+0000 7fd9c1e1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:43:58.898 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:43:58 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:43:58.494+0000 7fd9c1e1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:43:58.898 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:43:58 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:43:58.494+0000 7fd9c1e1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:43:59.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T08:43:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:59.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:59 smithi018 ceph-mon[30956]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 0 op/s 2024-09-19T08:43:59.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:43:59 smithi018 ceph-mon[30956]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:59 smithi162 ceph-mon[34870]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 0 op/s 2024-09-19T08:43:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:43:59 smithi162 ceph-mon[34870]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 -- 172.21.15.18:0/2295159080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 msgr2=0x7f9a381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/2295159080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381067e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009900 tx=0x7f9a2c02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 -- 172.21.15.18:0/2295159080 shutdown_connections 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/2295159080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38106f10 0x7f9a3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/2295159080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381067e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/2295159080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 0x7f9a381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 -- 172.21.15.18:0/2295159080 >> 172.21.15.18:0/2295159080 conn(0x7f9a380fd8c0 msgr2=0x7f9a380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 -- 172.21.15.18:0/2295159080 shutdown_connections 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.923+0000 7f9a3ff75640 1 -- 172.21.15.18:0/2295159080 wait complete. 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 Processor -- start 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 -- start start 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 0x7f9a381983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38106f10 0x7f9a3819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38111e20 con 0x7f9a38102790 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38111ca0 con 0x7f9a38101de0 2024-09-19T08:43:59.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3ff75640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38111fa0 con 0x7f9a38106f10 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3d510640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3d510640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50736/0 (socket says 172.21.15.18:50736) 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.924+0000 7f9a3d510640 1 -- 172.21.15.18:0/1878520293 learned_addr learned my addr 172.21.15.18:0/1878520293 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3e512640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38106f10 0x7f9a3819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3dd11640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 0x7f9a381983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3d510640 1 -- 172.21.15.18:0/1878520293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38106f10 msgr2=0x7f9a3819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3d510640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38106f10 0x7f9a3819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3d510640 1 -- 172.21.15.18:0/1878520293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 msgr2=0x7f9a381983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3d510640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 0x7f9a381983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3d510640 1 -- 172.21.15.18:0/1878520293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3819d350 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3dd11640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 0x7f9a381983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3d510640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381988e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c005940 tx=0x7f9a2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c03f030 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a2c003aa0 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3819d5e0 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c035070 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.925+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a381a4f20 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.926+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a381032c0 con 0x7f9a38102790 2024-09-19T08:43:59.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.928+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9a2c042030 con 0x7f9a38102790 2024-09-19T08:43:59.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.928+0000 7f9a2affd640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9a240a3240 0x7f9a240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.929+0000 7f9a3dd11640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9a240a3240 0x7f9a240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.929+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f9a2c0effd0 con 0x7f9a38102790 2024-09-19T08:43:59.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.929+0000 7f9a3dd11640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9a240a3240 0x7f9a240a5700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a340058c0 tx=0x7f9a34005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:59.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:43:59.933+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a2c0bcab0 con 0x7f9a38102790 2024-09-19T08:44:00.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:59 smithi150 ceph-mon[34610]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 0 op/s 2024-09-19T08:44:00.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:43:59 smithi150 ceph-mon[34610]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:00.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.134+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9a38062630 con 0x7f9a240a3240 2024-09-19T08:44:00.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.158+0000 7f9a2affd640 1 -- 172.21.15.18:0/1878520293 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9a38062630 con 0x7f9a240a3240 2024-09-19T08:44:00.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9a240a3240 msgr2=0x7f9a240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9a240a3240 0x7f9a240a5700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a340058c0 tx=0x7f9a34005ec0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 msgr2=0x7f9a381988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381988e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c005940 tx=0x7f9a2c004270 comp rx=0 tx=0).stop 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 shutdown_connections 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f9a240a3240 0x7f9a240a5700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38106f10 0x7f9a3819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38102790 0x7f9a381988e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 --2- 172.21.15.18:0/1878520293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a38101de0 0x7f9a381983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 >> 172.21.15.18:0/1878520293 conn(0x7f9a380fd8c0 msgr2=0x7f9a380feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 shutdown_connections 2024-09-19T08:44:00.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:00.161+0000 7f9a3ff75640 1 -- 172.21.15.18:0/1878520293 wait complete. 2024-09-19T08:44:00.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T08:44:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 -- 172.21.15.18:0/324138969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 msgr2=0x7fdd081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/324138969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081067e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009900 tx=0x7fdcf802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 -- 172.21.15.18:0/324138969 shutdown_connections 2024-09-19T08:44:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/324138969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 0x7fdd0810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/324138969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081067e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/324138969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 0x7fdd081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 -- 172.21.15.18:0/324138969 >> 172.21.15.18:0/324138969 conn(0x7fdd080fd8c0 msgr2=0x7fdd080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 -- 172.21.15.18:0/324138969 shutdown_connections 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.553+0000 7fdd0f28e640 1 -- 172.21.15.18:0/324138969 wait complete. 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 Processor -- start 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 -- start start 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 0x7fdd08198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 0x7fdd0819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd08111e20 con 0x7fdd08102790 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd08111ca0 con 0x7fdd08101de0 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0f28e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd08111fa0 con 0x7fdd08106f10 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0c829640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0c829640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50750/0 (socket says 172.21.15.18:50750) 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0c829640 1 -- 172.21.15.18:0/551588959 learned_addr learned my addr 172.21.15.18:0/551588959 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0d02a640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 0x7fdd08198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.554+0000 7fdd0d82b640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 0x7fdd0819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d02a640 1 -- 172.21.15.18:0/551588959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 msgr2=0x7fdd0819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d02a640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 0x7fdd0819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d02a640 1 -- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 msgr2=0x7fdd081988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d02a640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d02a640 1 -- 172.21.15.18:0/551588959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0819d310 con 0x7fdd08101de0 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d82b640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 0x7fdd0819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0c829640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0d02a640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 0x7fdd08198360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd04005fd0 tx=0x7fdd0400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04009c30 con 0x7fdd08101de0 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0819d600 con 0x7fdd08101de0 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd04009dd0 con 0x7fdd08101de0 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04003e20 con 0x7fdd08101de0 2024-09-19T08:44:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.555+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd081a4ee0 con 0x7fdd08101de0 2024-09-19T08:44:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.556+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd081021c0 con 0x7fdd08101de0 2024-09-19T08:44:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.558+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdd040035f0 con 0x7fdd08101de0 2024-09-19T08:44:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.558+0000 7fdcfe7fc640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdcf40a32d0 0x7fdcf40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.558+0000 7fdd0c829640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdcf40a32d0 0x7fdcf40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.558+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fdd040cf7f0 con 0x7fdd08101de0 2024-09-19T08:44:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.559+0000 7fdd0c829640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdcf40a32d0 0x7fdcf40a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8031440 tx=0x7fdcf80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.561+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdd04017020 con 0x7fdd08101de0 2024-09-19T08:44:01.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.765+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fdd08062630 con 0x7fdcf40a32d0 2024-09-19T08:44:01.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:01 smithi018 ceph-mon[30956]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-19T08:44:01.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:01 smithi018 ceph-mon[30956]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:01.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:01 smithi018 ceph-mon[30956]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:44:01.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.770+0000 7fdcfe7fc640 1 -- 172.21.15.18:0/551588959 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fdd08062630 con 0x7fdcf40a32d0 2024-09-19T08:44:01.771 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_0/adf712cf-7290-4ac0-98c8-dd17610ec168 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdcf40a32d0 msgr2=0x7fdcf40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdcf40a32d0 0x7fdcf40a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8031440 tx=0x7fdcf80058d0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 msgr2=0x7fdd08198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 0x7fdd08198360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd04005fd0 tx=0x7fdd0400dde0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 shutdown_connections 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdcf40a32d0 0x7fdcf40a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd08106f10 0x7fdd0819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd08102790 0x7fdd081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 --2- 172.21.15.18:0/551588959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd08101de0 0x7fdd08198360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 >> 172.21.15.18:0/551588959 conn(0x7fdd080fd8c0 msgr2=0x7fdd080fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 shutdown_connections 2024-09-19T08:44:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:01.772+0000 7fdd0f28e640 1 -- 172.21.15.18:0/551588959 wait complete. 2024-09-19T08:44:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:01 smithi162 ceph-mon[34870]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-19T08:44:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:01 smithi162 ceph-mon[34870]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:01 smithi162 ceph-mon[34870]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:44:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:01 smithi150 ceph-mon[34610]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-19T08:44:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:01 smithi150 ceph-mon[34610]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:01 smithi150 ceph-mon[34610]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:44:02.500 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T08:44:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 -- 172.21.15.18:0/4096959189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 msgr2=0x7f0034106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 --2- 172.21.15.18:0/4096959189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f0034106e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0024009930 tx=0x7f002402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 -- 172.21.15.18:0/4096959189 shutdown_connections 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 --2- 172.21.15.18:0/4096959189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0034101420 0x7f003410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 --2- 172.21.15.18:0/4096959189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0034100a80 0x7f0034100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 --2- 172.21.15.18:0/4096959189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f0034106e60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 -- 172.21.15.18:0/4096959189 >> 172.21.15.18:0/4096959189 conn(0x7f00340fc7a0 msgr2=0x7f00340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 -- 172.21.15.18:0/4096959189 shutdown_connections 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.252+0000 7f00391a8640 1 -- 172.21.15.18:0/4096959189 wait complete. 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 Processor -- start 2024-09-19T08:44:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 -- start start 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0034100a80 0x7f003419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0034101420 0x7f003419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f003419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0034110dd0 con 0x7f0034106a80 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0034110c50 con 0x7f0034100a80 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f00391a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0034110f50 con 0x7f0034101420 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f003359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f003419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f003359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f003419efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50772/0 (socket says 172.21.15.18:50772) 2024-09-19T08:44:03.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f003359e640 1 -- 172.21.15.18:0/2006956358 learned_addr learned my addr 172.21.15.18:0/2006956358 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.253+0000 7f0032d9d640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0034100a80 0x7f003419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003259c640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0034101420 0x7f003419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003359e640 1 -- 172.21.15.18:0/2006956358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0034101420 msgr2=0x7f003419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003359e640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0034101420 0x7f003419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003359e640 1 -- 172.21.15.18:0/2006956358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0034100a80 msgr2=0x7f003419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003359e640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0034100a80 0x7f003419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003359e640 1 -- 172.21.15.18:0/2006956358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003419f6a0 con 0x7f0034106a80 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f003359e640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f003419efc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f002c00b970 tx=0x7f002c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c019070 con 0x7f0034106a80 2024-09-19T08:44:03.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f002c014440 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003419f990 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0075d0 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.254+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00341a7270 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.255+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0034100f60 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.256+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f002c01c070 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.257+0000 7f001bfff640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f001c0a32d0 0x7f001c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.257+0000 7f0032d9d640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f001c0a32d0 0x7f001c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.257+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f002c0cf090 con 0x7f0034106a80 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.258+0000 7f0032d9d640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f001c0a32d0 0x7f001c0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0024006010 tx=0x7f0024000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.261+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f002c09b470 con 0x7f0034106a80 2024-09-19T08:44:03.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.467+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f003406aee0 con 0x7f001c0a32d0 2024-09-19T08:44:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.493+0000 7f001bfff640 1 -- 172.21.15.18:0/2006956358 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f003406aee0 con 0x7f001c0a32d0 2024-09-19T08:44:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f001c0a32d0 msgr2=0x7f001c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f001c0a32d0 0x7f001c0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0024006010 tx=0x7f0024000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 msgr2=0x7f003419efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f003419efc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f002c00b970 tx=0x7f002c00bd70 comp rx=0 tx=0).stop 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 shutdown_connections 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f001c0a32d0 0x7f001c0a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0034106a80 0x7f003419efc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0034101420 0x7f003419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 --2- 172.21.15.18:0/2006956358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0034100a80 0x7f003419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 >> 172.21.15.18:0/2006956358 conn(0x7f00340fc7a0 msgr2=0x7f003406a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 shutdown_connections 2024-09-19T08:44:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:03.495+0000 7f00391a8640 1 -- 172.21.15.18:0/2006956358 wait complete. 2024-09-19T08:44:03.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:03 smithi162 ceph-mon[34870]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:03 smithi162 ceph-mon[34870]: pgmap v308: 129 pgs: 129 active+clean; 601 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T08:44:03.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:03 smithi018 ceph-mon[30956]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:03.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:03 smithi018 ceph-mon[30956]: pgmap v308: 129 pgs: 129 active+clean; 601 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T08:44:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:03 smithi150 ceph-mon[34610]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:03 smithi150 ceph-mon[34610]: pgmap v308: 129 pgs: 129 active+clean; 601 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T08:44:04.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T08:44:04.404 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:04.810 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:04 smithi018 ceph-mon[30956]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:04.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:04 smithi162 ceph-mon[34870]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 -- 172.21.15.18:0/2204820268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f779810c170 msgr2=0x7f779810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 --2- 172.21.15.18:0/2204820268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f779810c170 0x7f779810e610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7790009ca0 tx=0x7f779002a950 comp rx=0 tx=0).stop 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 -- 172.21.15.18:0/2204820268 shutdown_connections 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 --2- 172.21.15.18:0/2204820268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f779810c170 0x7f779810e610 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 --2- 172.21.15.18:0/2204820268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7798103660 0x7f779810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 --2- 172.21.15.18:0/2204820268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798102d40 0x7f7798103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 -- 172.21.15.18:0/2204820268 >> 172.21.15.18:0/2204820268 conn(0x7f77980fc7a0 msgr2=0x7f77980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 -- 172.21.15.18:0/2204820268 shutdown_connections 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.899+0000 7f779e24f640 1 -- 172.21.15.18:0/2204820268 wait complete. 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.900+0000 7f779e24f640 1 Processor -- start 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.900+0000 7f779e24f640 1 -- start start 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 0x7f7798198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798103660 0x7f7798198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f779810c170 0x7f779819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7798111e20 con 0x7f7798102d40 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7798111ca0 con 0x7f7798103660 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7798111fa0 con 0x7f779810c170 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 0x7f7798198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 0x7f7798198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50800/0 (socket says 172.21.15.18:50800) 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 -- 172.21.15.18:0/813187489 learned_addr learned my addr 172.21.15.18:0/813187489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f7796ffd640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798103660 0x7f7798198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 -- 172.21.15.18:0/813187489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f779810c170 msgr2=0x7f779819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f779810c170 0x7f779819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 -- 172.21.15.18:0/813187489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798103660 msgr2=0x7f7798198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798103660 0x7f7798198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 -- 172.21.15.18:0/813187489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779819d2d0 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f7796ffd640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798103660 0x7f7798198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f77977fe640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 0x7f7798198320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f778800d950 tx=0x7f778800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788017070 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7788009c30 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779819d5c0 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.901+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778800f620 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.902+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77981a4ea0 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.903+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7798103120 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.904+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f77880109a0 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.904+0000 7f7794ff9640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f77800a3350 0x7f77800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.905+0000 7f7796ffd640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f77800a3350 0x7f77800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.905+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f77880cf950 con 0x7f7798102d40 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.905+0000 7f7796ffd640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f77800a3350 0x7f77800a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f778c005fd0 tx=0x7f778c005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:04.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:04.909+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7788009de0 con 0x7f7798102d40 2024-09-19T08:44:05.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:04 smithi150 ceph-mon[34610]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.111+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7798062630 con 0x7f77800a3350 2024-09-19T08:44:05.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.116+0000 7f7794ff9640 1 -- 172.21.15.18:0/813187489 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7798062630 con 0x7f77800a3350 2024-09-19T08:44:05.117 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_1/d56edc83-2b4c-4d6d-b50f-ba01ac9f3d0a 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f77800a3350 msgr2=0x7f77800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f77800a3350 0x7f77800a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f778c005fd0 tx=0x7f778c005f00 comp rx=0 tx=0).stop 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 msgr2=0x7f7798198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 0x7f7798198320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f778800d950 tx=0x7f778800de10 comp rx=0 tx=0).stop 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 shutdown_connections 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f77800a3350 0x7f77800a5810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f779810c170 0x7f779819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7798103660 0x7f7798198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 --2- 172.21.15.18:0/813187489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7798102d40 0x7f7798198320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.118+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 >> 172.21.15.18:0/813187489 conn(0x7f77980fc7a0 msgr2=0x7f77980fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.119+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 shutdown_connections 2024-09-19T08:44:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:05.119+0000 7f779e24f640 1 -- 172.21.15.18:0/813187489 wait complete. 2024-09-19T08:44:05.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:05 smithi018 ceph-mon[30956]: pgmap v309: 129 pgs: 129 active+clean; 601 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T08:44:05.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:05 smithi162 ceph-mon[34870]: pgmap v309: 129 pgs: 129 active+clean; 601 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T08:44:06.020 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:05 smithi150 ceph-mon[34610]: pgmap v309: 129 pgs: 129 active+clean; 601 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T08:44:06.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 -- 172.21.15.18:0/896752235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 msgr2=0x7f94f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 --2- 172.21.15.18:0/896752235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f410ea90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009ca0 tx=0x7f94ec02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 -- 172.21.15.18:0/896752235 shutdown_connections 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 --2- 172.21.15.18:0/896752235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f410ea90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 --2- 172.21.15.18:0/896752235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 0x7f94f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 --2- 172.21.15.18:0/896752235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f4101de0 0x7f94f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 -- 172.21.15.18:0/896752235 >> 172.21.15.18:0/896752235 conn(0x7f94f40fd8c0 msgr2=0x7f94f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 -- 172.21.15.18:0/896752235 shutdown_connections 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.488+0000 7f94f91e4640 1 -- 172.21.15.18:0/896752235 wait complete. 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 Processor -- start 2024-09-19T08:44:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 -- start start 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f4101de0 0x7f94f41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 0x7f94f41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94f4111e70 con 0x7f94f4106f10 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94f4111cf0 con 0x7f94f4102790 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f91e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94f4111ff0 con 0x7f94f4101de0 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50826/0 (socket says 172.21.15.18:50826) 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f359e640 1 -- 172.21.15.18:0/4177028594 learned_addr learned my addr 172.21.15.18:0/4177028594 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f2d9d640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f4101de0 0x7f94f41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.489+0000 7f94f259c640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 0x7f94f41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f359e640 1 -- 172.21.15.18:0/4177028594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f4101de0 msgr2=0x7f94f41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f359e640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f4101de0 0x7f94f41983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f359e640 1 -- 172.21.15.18:0/4177028594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 msgr2=0x7f94f41988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f359e640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 0x7f94f41988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f359e640 1 -- 172.21.15.18:0/4177028594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f419d360 con 0x7f94f4106f10 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f259c640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 0x7f94f41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f359e640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f419cc80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f94ec031040 tx=0x7f94ec003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec003ce0 con 0x7f94f4106f10 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94ec0044f0 con 0x7f94f4106f10 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f419d5f0 con 0x7f94f4106f10 2024-09-19T08:44:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec030c90 con 0x7f94f4106f10 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.490+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f41a4f30 con 0x7f94f4106f10 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.491+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f41021c0 con 0x7f94f4106f10 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.492+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f94ec0046a0 con 0x7f94f4106f10 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.493+0000 7f94dbfff640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94dc0a32d0 0x7f94dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.493+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f94ec0f13f0 con 0x7f94f4106f10 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.493+0000 7f94f2d9d640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94dc0a32d0 0x7f94dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.493+0000 7f94f2d9d640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94dc0a32d0 0x7f94dc0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94e4005fd0 tx=0x7f94e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.496+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94ec0bde80 con 0x7f94f4106f10 2024-09-19T08:44:06.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.710+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94f410a150 con 0x7f94f4106f10 2024-09-19T08:44:06.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.710+0000 7f94dbfff640 1 -- 172.21.15.18:0/4177028594 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f94ec0bd780 con 0x7f94f4106f10 2024-09-19T08:44:06.711 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:06.711 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:44:06.712 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:44:06.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94dc0a32d0 msgr2=0x7f94dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94dc0a32d0 0x7f94dc0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94e4005fd0 tx=0x7f94e400b390 comp rx=0 tx=0).stop 2024-09-19T08:44:06.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 msgr2=0x7f94f419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f419cc80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f94ec031040 tx=0x7f94ec003970 comp rx=0 tx=0).stop 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 shutdown_connections 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94dc0a32d0 0x7f94dc0a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f4106f10 0x7f94f419cc80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f4102790 0x7f94f41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 --2- 172.21.15.18:0/4177028594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f4101de0 0x7f94f41983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 >> 172.21.15.18:0/4177028594 conn(0x7f94f40fd8c0 msgr2=0x7f94f40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 shutdown_connections 2024-09-19T08:44:06.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:06.713+0000 7f94f91e4640 1 -- 172.21.15.18:0/4177028594 wait complete. 2024-09-19T08:44:06.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:06 smithi162 ceph-mon[34870]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:06.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:06 smithi018 ceph-mon[30956]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:07.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:06 smithi150 ceph-mon[34610]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:07.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:07.625 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:07.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:07 smithi018 ceph-mon[30956]: pgmap v310: 129 pgs: 129 active+clean; 602 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-19T08:44:07.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:07 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4177028594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:07.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:07 smithi162 ceph-mon[34870]: pgmap v310: 129 pgs: 129 active+clean; 602 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-19T08:44:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:07 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/4177028594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:07 smithi150 ceph-mon[34610]: pgmap v310: 129 pgs: 129 active+clean; 602 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-19T08:44:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:07 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/4177028594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:08.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 -- 172.21.15.18:0/1718348863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 msgr2=0x7f000010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 --2- 172.21.15.18:0/1718348863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000010df40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efff0009900 tx=0x7efff002a410 comp rx=0 tx=0).stop 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 -- 172.21.15.18:0/1718348863 shutdown_connections 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 --2- 172.21.15.18:0/1718348863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f000010e480 0x7f0000110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 --2- 172.21.15.18:0/1718348863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000010df40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 --2- 172.21.15.18:0/1718348863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00001008d0 0x7f0000100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 -- 172.21.15.18:0/1718348863 >> 172.21.15.18:0/1718348863 conn(0x7f00000fc7a0 msgr2=0x7f00000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 -- 172.21.15.18:0/1718348863 shutdown_connections 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.122+0000 7f0007db4640 1 -- 172.21.15.18:0/1718348863 wait complete. 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 Processor -- start 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 -- start start 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00001008d0 0x7f000019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f000010e480 0x7f000019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f00001140b0 con 0x7f0000101280 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0000113f30 con 0x7f000010e480 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f0007db4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0000114230 con 0x7f00001008d0 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f000534f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f000534f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50842/0 (socket says 172.21.15.18:50842) 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.123+0000 7f000534f640 1 -- 172.21.15.18:0/1582592548 learned_addr learned my addr 172.21.15.18:0/1582592548 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f0005b50640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00001008d0 0x7f000019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f0006351640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f000010e480 0x7f000019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f000534f640 1 -- 172.21.15.18:0/1582592548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00001008d0 msgr2=0x7f000019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f000534f640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00001008d0 0x7f000019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f000534f640 1 -- 172.21.15.18:0/1582592548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f000010e480 msgr2=0x7f000019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f000534f640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f000010e480 0x7f000019eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f000534f640 1 -- 172.21.15.18:0/1582592548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000019f5c0 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f000534f640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000019ab50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efff0005ab0 tx=0x7efff0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff003f070 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000019f850 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efff0031d60 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0035030 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.124+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00001a7190 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.125+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0000100cb0 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.126+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efff0042070 con 0x7f0000101280 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.127+0000 7efff6ffd640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7effec0a32d0 0x7effec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.127+0000 7f0005b50640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7effec0a32d0 0x7effec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.127+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7efff00f06f0 con 0x7f0000101280 2024-09-19T08:44:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.127+0000 7f0005b50640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7effec0a32d0 0x7effec0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efffc005fd0 tx=0x7efffc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.131+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efff00bd010 con 0x7f0000101280 2024-09-19T08:44:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.307+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0000109640 con 0x7f0000101280 2024-09-19T08:44:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.309+0000 7efff6ffd640 1 -- 172.21.15.18:0/1582592548 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7efff00bc910 con 0x7f0000101280 2024-09-19T08:44:08.310 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:08.310 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7effec0a32d0 msgr2=0x7effec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7effec0a32d0 0x7effec0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efffc005fd0 tx=0x7efffc005850 comp rx=0 tx=0).stop 2024-09-19T08:44:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 msgr2=0x7f000019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000019ab50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efff0005ab0 tx=0x7efff0003cd0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 shutdown_connections 2024-09-19T08:44:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7effec0a32d0 0x7effec0a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f000010e480 0x7f000019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0000101280 0x7f000019ab50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 --2- 172.21.15.18:0/1582592548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00001008d0 0x7f000019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 >> 172.21.15.18:0/1582592548 conn(0x7f00000fc7a0 msgr2=0x7f000010f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 shutdown_connections 2024-09-19T08:44:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:08.311+0000 7f0007db4640 1 -- 172.21.15.18:0/1582592548 wait complete. 2024-09-19T08:44:08.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:08 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1582592548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:09.038 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:44:09.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:09.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:08 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1582592548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:09.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:08 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1582592548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 -- 172.21.15.18:0/2724016827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214102790 msgr2=0x7fd2141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 --2- 172.21.15.18:0/2724016827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214102790 0x7fd2141067e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd208009900 tx=0x7fd20802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 -- 172.21.15.18:0/2724016827 shutdown_connections 2024-09-19T08:44:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 --2- 172.21.15.18:0/2724016827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd214106f10 0x7fd21410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 --2- 172.21.15.18:0/2724016827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214102790 0x7fd2141067e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 --2- 172.21.15.18:0/2724016827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd214101de0 0x7fd2141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 -- 172.21.15.18:0/2724016827 >> 172.21.15.18:0/2724016827 conn(0x7fd2140fd8c0 msgr2=0x7fd2140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 -- 172.21.15.18:0/2724016827 shutdown_connections 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.811+0000 7fd218e74640 1 -- 172.21.15.18:0/2724016827 wait complete. 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 Processor -- start 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 -- start start 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 0x7fd2140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd214102790 0x7fd214074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd214106f10 0x7fd214074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111e20 con 0x7fd214101de0 2024-09-19T08:44:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111ca0 con 0x7fd214106f10 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd218e74640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111fa0 con 0x7fd214102790 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 0x7fd2140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 0x7fd2140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51272/0 (socket says 172.21.15.18:51272) 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 -- 172.21.15.18:0/3546682165 learned_addr learned my addr 172.21.15.18:0/3546682165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd212d9d640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd214106f10 0x7fd214074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd211d9b640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd214102790 0x7fd214074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 -- 172.21.15.18:0/3546682165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd214102790 msgr2=0x7fd214074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd214102790 0x7fd214074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 -- 172.21.15.18:0/3546682165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd214106f10 msgr2=0x7fd214074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd214106f10 0x7fd214074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.812+0000 7fd21259c640 1 -- 172.21.15.18:0/3546682165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2141a6860 con 0x7fd214101de0 2024-09-19T08:44:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.813+0000 7fd21259c640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 0x7fd2140744f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd20400d950 tx=0x7fd20400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.813+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204017030 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.813+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd204004020 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.813+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2141a6b50 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.813+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2040047a0 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.813+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2141a7060 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.814+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2141021c0 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.815+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd2040041d0 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.816+0000 7fd2037fe640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd1fc0a32d0 0x7fd1fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.816+0000 7fd211d9b640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd1fc0a32d0 0x7fd1fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.816+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fd2040cf6d0 con 0x7fd214101de0 2024-09-19T08:44:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.816+0000 7fd211d9b640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd1fc0a32d0 0x7fd1fc0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd208031440 tx=0x7fd208005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:09.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:09.820+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd20409c050 con 0x7fd214101de0 2024-09-19T08:44:09.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:09 smithi018 ceph-mon[30956]: pgmap v311: 129 pgs: 129 active+clean; 625 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-19T08:44:09.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:10.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.004+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd214062630 con 0x7fd1fc0a32d0 2024-09-19T08:44:10.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.015+0000 7fd2037fe640 1 -- 172.21.15.18:0/3546682165 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340254 (secure 0 0 0) 0x7fd214062630 con 0x7fd1fc0a32d0 2024-09-19T08:44:10.019 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:10.020 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T08:44:10.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd1fc0a32d0 msgr2=0x7fd1fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd1fc0a32d0 0x7fd1fc0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd208031440 tx=0x7fd208005b50 comp rx=0 tx=0).stop 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 msgr2=0x7fd2140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 0x7fd2140744f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd20400d950 tx=0x7fd20400de10 comp rx=0 tx=0).stop 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 shutdown_connections 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd1fc0a32d0 0x7fd1fc0a5790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd214106f10 0x7fd214074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd214102790 0x7fd214074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 --2- 172.21.15.18:0/3546682165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd214101de0 0x7fd2140744f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 >> 172.21.15.18:0/3546682165 conn(0x7fd2140fd8c0 msgr2=0x7fd2140fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.018+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 shutdown_connections 2024-09-19T08:44:10.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:10.019+0000 7fd218e74640 1 -- 172.21.15.18:0/3546682165 wait complete. 2024-09-19T08:44:10.060 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:09 smithi150 ceph-mon[34610]: pgmap v311: 129 pgs: 129 active+clean; 625 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-19T08:44:10.060 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:09 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:10.107 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:09 smithi162 ceph-mon[34870]: pgmap v311: 129 pgs: 129 active+clean; 625 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-19T08:44:10.107 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:09 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:11.398 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-19T08:44:09.859536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640498,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":178,"num_write":256,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387448,"kb_used_data":13232,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554376,"statfs":{"total":1151940427776,"available":1151543681024,"internally_reserved":0,"allocated":13549568,"data_stored":7626044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45488,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":57,"num_write":26,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003153"},"pg_stats":[{"pgid":"2.1f","version":"80'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072228+0000","last_change":"2024-09-19T08:43:11.457240+0000","last_active":"2024-09-19T08:43:25.072228+0000","last_peered":"2024-09-19T08:43:25.072228+0000","last_clean":"2024-09-19T08:43:25.072228+0000","last_became_active":"2024-09-19T08:43:11.456921+0000","last_became_peered":"2024-09-19T08:43:11.456921+0000","last_unstale":"2024-09-19T08:43:25.072228+0000","last_undegraded":"2024-09-19T08:43:25.072228+0000","last_fullsized":"2024-09-19T08:43:25.072228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:39.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547351+0000","last_change":"2024-09-19T08:43:13.510724+0000","last_active":"2024-09-19T08:43:23.547351+0000","last_peered":"2024-09-19T08:43:23.547351+0000","last_clean":"2024-09-19T08:43:23.547351+0000","last_became_active":"2024-09-19T08:43:13.506747+0000","last_became_peered":"2024-09-19T08:43:13.506747+0000","last_unstale":"2024-09-19T08:43:23.547351+0000","last_undegraded":"2024-09-19T08:43:23.547351+0000","last_fullsized":"2024-09-19T08:43:23.547351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:07.182413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930409+0000","last_change":"2024-09-19T08:43:20.550571+0000","last_active":"2024-09-19T08:43:24.930409+0000","last_peered":"2024-09-19T08:43:24.930409+0000","last_clean":"2024-09-19T08:43:24.930409+0000","last_became_active":"2024-09-19T08:43:20.550197+0000","last_became_peered":"2024-09-19T08:43:20.550197+0000","last_unstale":"2024-09-19T08:43:24.930409+0000","last_undegraded":"2024-09-19T08:43:24.930409+0000","last_fullsized":"2024-09-19T08:43:24.930409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:52.442760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547814+0000","last_change":"2024-09-19T08:43:12.059489+0000","last_active":"2024-09-19T08:43:23.547814+0000","last_peered":"2024-09-19T08:43:23.547814+0000","last_clean":"2024-09-19T08:43:23.547814+0000","last_became_active":"2024-09-19T08:43:12.059130+0000","last_became_peered":"2024-09-19T08:43:12.059130+0000","last_unstale":"2024-09-19T08:43:23.547814+0000","last_undegraded":"2024-09-19T08:43:23.547814+0000","last_fullsized":"2024-09-19T08:43:23.547814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:09.336149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006787+0000","last_change":"2024-09-19T08:43:13.511634+0000","last_active":"2024-09-19T08:43:26.006787+0000","last_peered":"2024-09-19T08:43:26.006787+0000","last_clean":"2024-09-19T08:43:26.006787+0000","last_became_active":"2024-09-19T08:43:13.510929+0000","last_became_peered":"2024-09-19T08:43:13.510929+0000","last_unstale":"2024-09-19T08:43:26.006787+0000","last_undegraded":"2024-09-19T08:43:26.006787+0000","last_fullsized":"2024-09-19T08:43:26.006787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:30.793265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597372+0000","last_change":"2024-09-19T08:43:20.542072+0000","last_active":"2024-09-19T08:43:24.597372+0000","last_peered":"2024-09-19T08:43:24.597372+0000","last_clean":"2024-09-19T08:43:24.597372+0000","last_became_active":"2024-09-19T08:43:20.541594+0000","last_became_peered":"2024-09-19T08:43:20.541594+0000","last_unstale":"2024-09-19T08:43:24.597372+0000","last_undegraded":"2024-09-19T08:43:24.597372+0000","last_fullsized":"2024-09-19T08:43:24.597372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:03.635376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007186+0000","last_change":"2024-09-19T08:43:11.459663+0000","last_active":"2024-09-19T08:43:26.007186+0000","last_peered":"2024-09-19T08:43:26.007186+0000","last_clean":"2024-09-19T08:43:26.007186+0000","last_became_active":"2024-09-19T08:43:11.459341+0000","last_became_peered":"2024-09-19T08:43:11.459341+0000","last_unstale":"2024-09-19T08:43:26.007186+0000","last_undegraded":"2024-09-19T08:43:26.007186+0000","last_fullsized":"2024-09-19T08:43:26.007186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:55.861085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547847+0000","last_change":"2024-09-19T08:43:13.511108+0000","last_active":"2024-09-19T08:43:23.547847+0000","last_peered":"2024-09-19T08:43:23.547847+0000","last_clean":"2024-09-19T08:43:23.547847+0000","last_became_active":"2024-09-19T08:43:13.510319+0000","last_became_peered":"2024-09-19T08:43:13.510319+0000","last_unstale":"2024-09-19T08:43:23.547847+0000","last_undegraded":"2024-09-19T08:43:23.547847+0000","last_fullsized":"2024-09-19T08:43:23.547847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.119101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597751+0000","last_change":"2024-09-19T08:43:20.541003+0000","last_active":"2024-09-19T08:43:24.597751+0000","last_peered":"2024-09-19T08:43:24.597751+0000","last_clean":"2024-09-19T08:43:24.597751+0000","last_became_active":"2024-09-19T08:43:20.540597+0000","last_became_peered":"2024-09-19T08:43:20.540597+0000","last_unstale":"2024-09-19T08:43:24.597751+0000","last_undegraded":"2024-09-19T08:43:24.597751+0000","last_fullsized":"2024-09-19T08:43:24.597751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:11.553758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007176+0000","last_change":"2024-09-19T08:43:11.460680+0000","last_active":"2024-09-19T08:43:26.007176+0000","last_peered":"2024-09-19T08:43:26.007176+0000","last_clean":"2024-09-19T08:43:26.007176+0000","last_became_active":"2024-09-19T08:43:11.460335+0000","last_became_peered":"2024-09-19T08:43:11.460335+0000","last_unstale":"2024-09-19T08:43:26.007176+0000","last_undegraded":"2024-09-19T08:43:26.007176+0000","last_fullsized":"2024-09-19T08:43:26.007176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:51.332244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548168+0000","last_change":"2024-09-19T08:43:13.514161+0000","last_active":"2024-09-19T08:43:23.548168+0000","last_peered":"2024-09-19T08:43:23.548168+0000","last_clean":"2024-09-19T08:43:23.548168+0000","last_became_active":"2024-09-19T08:43:13.513674+0000","last_became_peered":"2024-09-19T08:43:13.513674+0000","last_unstale":"2024-09-19T08:43:23.548168+0000","last_undegraded":"2024-09-19T08:43:23.548168+0000","last_fullsized":"2024-09-19T08:43:23.548168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:15.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597514+0000","last_change":"2024-09-19T08:43:20.543781+0000","last_active":"2024-09-19T08:43:24.597514+0000","last_peered":"2024-09-19T08:43:24.597514+0000","last_clean":"2024-09-19T08:43:24.597514+0000","last_became_active":"2024-09-19T08:43:20.543476+0000","last_became_peered":"2024-09-19T08:43:20.543476+0000","last_unstale":"2024-09-19T08:43:24.597514+0000","last_undegraded":"2024-09-19T08:43:24.597514+0000","last_fullsized":"2024-09-19T08:43:24.597514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:27.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934961+0000","last_change":"2024-09-19T08:43:13.512711+0000","last_active":"2024-09-19T08:43:24.934961+0000","last_peered":"2024-09-19T08:43:24.934961+0000","last_clean":"2024-09-19T08:43:24.934961+0000","last_became_active":"2024-09-19T08:43:13.512406+0000","last_became_peered":"2024-09-19T08:43:13.512406+0000","last_unstale":"2024-09-19T08:43:24.934961+0000","last_undegraded":"2024-09-19T08:43:24.934961+0000","last_fullsized":"2024-09-19T08:43:24.934961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:23.765966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006919+0000","last_change":"2024-09-19T08:43:11.460442+0000","last_active":"2024-09-19T08:43:26.006919+0000","last_peered":"2024-09-19T08:43:26.006919+0000","last_clean":"2024-09-19T08:43:26.006919+0000","last_became_active":"2024-09-19T08:43:11.460113+0000","last_became_peered":"2024-09-19T08:43:11.460113+0000","last_unstale":"2024-09-19T08:43:26.006919+0000","last_undegraded":"2024-09-19T08:43:26.006919+0000","last_fullsized":"2024-09-19T08:43:26.006919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:29.528307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597874+0000","last_change":"2024-09-19T08:43:20.861786+0000","last_active":"2024-09-19T08:43:24.597874+0000","last_peered":"2024-09-19T08:43:24.597874+0000","last_clean":"2024-09-19T08:43:24.597874+0000","last_became_active":"2024-09-19T08:43:20.861281+0000","last_became_peered":"2024-09-19T08:43:20.861281+0000","last_unstale":"2024-09-19T08:43:24.597874+0000","last_undegraded":"2024-09-19T08:43:24.597874+0000","last_fullsized":"2024-09-19T08:43:24.597874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:47.336930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547358+0000","last_change":"2024-09-19T08:43:13.506879+0000","last_active":"2024-09-19T08:43:23.547358+0000","last_peered":"2024-09-19T08:43:23.547358+0000","last_clean":"2024-09-19T08:43:23.547358+0000","last_became_active":"2024-09-19T08:43:13.506568+0000","last_became_peered":"2024-09-19T08:43:13.506568+0000","last_unstale":"2024-09-19T08:43:23.547358+0000","last_undegraded":"2024-09-19T08:43:23.547358+0000","last_fullsized":"2024-09-19T08:43:23.547358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:50.324234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930420+0000","last_change":"2024-09-19T08:43:11.458197+0000","last_active":"2024-09-19T08:43:24.930420+0000","last_peered":"2024-09-19T08:43:24.930420+0000","last_clean":"2024-09-19T08:43:24.930420+0000","last_became_active":"2024-09-19T08:43:11.457591+0000","last_became_peered":"2024-09-19T08:43:11.457591+0000","last_unstale":"2024-09-19T08:43:24.930420+0000","last_undegraded":"2024-09-19T08:43:24.930420+0000","last_fullsized":"2024-09-19T08:43:24.930420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:05.965594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597873+0000","last_change":"2024-09-19T08:43:20.541453+0000","last_active":"2024-09-19T08:43:24.597873+0000","last_peered":"2024-09-19T08:43:24.597873+0000","last_clean":"2024-09-19T08:43:24.597873+0000","last_became_active":"2024-09-19T08:43:20.541014+0000","last_became_peered":"2024-09-19T08:43:20.541014+0000","last_unstale":"2024-09-19T08:43:24.597873+0000","last_undegraded":"2024-09-19T08:43:24.597873+0000","last_fullsized":"2024-09-19T08:43:24.597873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.373513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.370962+0000","last_change":"2024-09-19T08:43:13.508404+0000","last_active":"2024-09-19T08:43:24.370962+0000","last_peered":"2024-09-19T08:43:24.370962+0000","last_clean":"2024-09-19T08:43:24.370962+0000","last_became_active":"2024-09-19T08:43:13.508018+0000","last_became_peered":"2024-09-19T08:43:13.508018+0000","last_unstale":"2024-09-19T08:43:24.370962+0000","last_undegraded":"2024-09-19T08:43:24.370962+0000","last_fullsized":"2024-09-19T08:43:24.370962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:43.795388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547346+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:43:23.547346+0000","last_peered":"2024-09-19T08:43:23.547346+0000","last_clean":"2024-09-19T08:43:23.547346+0000","last_became_active":"2024-09-19T08:43:11.463696+0000","last_became_peered":"2024-09-19T08:43:11.463696+0000","last_unstale":"2024-09-19T08:43:23.547346+0000","last_undegraded":"2024-09-19T08:43:23.547346+0000","last_fullsized":"2024-09-19T08:43:23.547346+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:18.658727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072087+0000","last_change":"2024-09-19T08:43:20.547619+0000","last_active":"2024-09-19T08:43:25.072087+0000","last_peered":"2024-09-19T08:43:25.072087+0000","last_clean":"2024-09-19T08:43:25.072087+0000","last_became_active":"2024-09-19T08:43:20.547229+0000","last_became_peered":"2024-09-19T08:43:20.547229+0000","last_unstale":"2024-09-19T08:43:25.072087+0000","last_undegraded":"2024-09-19T08:43:25.072087+0000","last_fullsized":"2024-09-19T08:43:25.072087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:21.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006676+0000","last_change":"2024-09-19T08:43:13.501280+0000","last_active":"2024-09-19T08:43:26.006676+0000","last_peered":"2024-09-19T08:43:26.006676+0000","last_clean":"2024-09-19T08:43:26.006676+0000","last_became_active":"2024-09-19T08:43:13.500951+0000","last_became_peered":"2024-09-19T08:43:13.500951+0000","last_unstale":"2024-09-19T08:43:26.006676+0000","last_undegraded":"2024-09-19T08:43:26.006676+0000","last_fullsized":"2024-09-19T08:43:26.006676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:32.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547541+0000","last_change":"2024-09-19T08:43:12.059831+0000","last_active":"2024-09-19T08:43:23.547541+0000","last_peered":"2024-09-19T08:43:23.547541+0000","last_clean":"2024-09-19T08:43:23.547541+0000","last_became_active":"2024-09-19T08:43:12.059476+0000","last_became_peered":"2024-09-19T08:43:12.059476+0000","last_unstale":"2024-09-19T08:43:23.547541+0000","last_undegraded":"2024-09-19T08:43:23.547541+0000","last_fullsized":"2024-09-19T08:43:23.547541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:07.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597930+0000","last_change":"2024-09-19T08:43:20.862549+0000","last_active":"2024-09-19T08:43:24.597930+0000","last_peered":"2024-09-19T08:43:24.597930+0000","last_clean":"2024-09-19T08:43:24.597930+0000","last_became_active":"2024-09-19T08:43:20.862132+0000","last_became_peered":"2024-09-19T08:43:20.862132+0000","last_unstale":"2024-09-19T08:43:24.597930+0000","last_undegraded":"2024-09-19T08:43:24.597930+0000","last_fullsized":"2024-09-19T08:43:24.597930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:21.979379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006616+0000","last_change":"2024-09-19T08:43:13.501448+0000","last_active":"2024-09-19T08:43:26.006616+0000","last_peered":"2024-09-19T08:43:26.006616+0000","last_clean":"2024-09-19T08:43:26.006616+0000","last_became_active":"2024-09-19T08:43:13.501037+0000","last_became_peered":"2024-09-19T08:43:13.501037+0000","last_unstale":"2024-09-19T08:43:26.006616+0000","last_undegraded":"2024-09-19T08:43:26.006616+0000","last_fullsized":"2024-09-19T08:43:26.006616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:55.190450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.598146+0000","last_change":"2024-09-19T08:43:11.512783+0000","last_active":"2024-09-19T08:43:24.598146+0000","last_peered":"2024-09-19T08:43:24.598146+0000","last_clean":"2024-09-19T08:43:24.598146+0000","last_became_active":"2024-09-19T08:43:11.512396+0000","last_became_peered":"2024-09-19T08:43:11.512396+0000","last_unstale":"2024-09-19T08:43:24.598146+0000","last_undegraded":"2024-09-19T08:43:24.598146+0000","last_fullsized":"2024-09-19T08:43:24.598146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.113193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930652+0000","last_change":"2024-09-19T08:43:20.539200+0000","last_active":"2024-09-19T08:43:24.930652+0000","last_peered":"2024-09-19T08:43:24.930652+0000","last_clean":"2024-09-19T08:43:24.930652+0000","last_became_active":"2024-09-19T08:43:20.538778+0000","last_became_peered":"2024-09-19T08:43:20.538778+0000","last_unstale":"2024-09-19T08:43:24.930652+0000","last_undegraded":"2024-09-19T08:43:24.930652+0000","last_fullsized":"2024-09-19T08:43:24.930652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:27.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548055+0000","last_change":"2024-09-19T08:43:13.505769+0000","last_active":"2024-09-19T08:43:23.548055+0000","last_peered":"2024-09-19T08:43:23.548055+0000","last_clean":"2024-09-19T08:43:23.548055+0000","last_became_active":"2024-09-19T08:43:13.503276+0000","last_became_peered":"2024-09-19T08:43:13.503276+0000","last_unstale":"2024-09-19T08:43:23.548055+0000","last_undegraded":"2024-09-19T08:43:23.548055+0000","last_fullsized":"2024-09-19T08:43:23.548055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:58.137325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:44:04.526246+0000","last_change":"2024-09-19T08:43:11.453959+0000","last_active":"2024-09-19T08:44:04.526246+0000","last_peered":"2024-09-19T08:44:04.526246+0000","last_clean":"2024-09-19T08:44:04.526246+0000","last_became_active":"2024-09-19T08:43:11.453645+0000","last_became_peered":"2024-09-19T08:43:11.453645+0000","last_unstale":"2024-09-19T08:44:04.526246+0000","last_undegraded":"2024-09-19T08:44:04.526246+0000","last_fullsized":"2024-09-19T08:44:04.526246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:30.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547086+0000","last_change":"2024-09-19T08:43:20.861812+0000","last_active":"2024-09-19T08:43:23.547086+0000","last_peered":"2024-09-19T08:43:23.547086+0000","last_clean":"2024-09-19T08:43:23.547086+0000","last_became_active":"2024-09-19T08:43:20.861180+0000","last_became_peered":"2024-09-19T08:43:20.861180+0000","last_unstale":"2024-09-19T08:43:23.547086+0000","last_undegraded":"2024-09-19T08:43:23.547086+0000","last_fullsized":"2024-09-19T08:43:23.547086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:24.200250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007456+0000","last_change":"2024-09-19T08:43:13.500991+0000","last_active":"2024-09-19T08:43:26.007456+0000","last_peered":"2024-09-19T08:43:26.007456+0000","last_clean":"2024-09-19T08:43:26.007456+0000","last_became_active":"2024-09-19T08:43:13.500676+0000","last_became_peered":"2024-09-19T08:43:13.500676+0000","last_unstale":"2024-09-19T08:43:26.007456+0000","last_undegraded":"2024-09-19T08:43:26.007456+0000","last_fullsized":"2024-09-19T08:43:26.007456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:38.201131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007197+0000","last_change":"2024-09-19T08:43:12.059273+0000","last_active":"2024-09-19T08:43:26.007197+0000","last_peered":"2024-09-19T08:43:26.007197+0000","last_clean":"2024-09-19T08:43:26.007197+0000","last_became_active":"2024-09-19T08:43:12.058873+0000","last_became_peered":"2024-09-19T08:43:12.058873+0000","last_unstale":"2024-09-19T08:43:26.007197+0000","last_undegraded":"2024-09-19T08:43:26.007197+0000","last_fullsized":"2024-09-19T08:43:26.007197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:43.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371059+0000","last_change":"2024-09-19T08:43:20.543459+0000","last_active":"2024-09-19T08:43:24.371059+0000","last_peered":"2024-09-19T08:43:24.371059+0000","last_clean":"2024-09-19T08:43:24.371059+0000","last_became_active":"2024-09-19T08:43:20.542946+0000","last_became_peered":"2024-09-19T08:43:20.542946+0000","last_unstale":"2024-09-19T08:43:24.371059+0000","last_undegraded":"2024-09-19T08:43:24.371059+0000","last_fullsized":"2024-09-19T08:43:24.371059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:19.423576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007296+0000","last_change":"2024-09-19T08:43:13.506844+0000","last_active":"2024-09-19T08:43:26.007296+0000","last_peered":"2024-09-19T08:43:26.007296+0000","last_clean":"2024-09-19T08:43:26.007296+0000","last_became_active":"2024-09-19T08:43:13.506495+0000","last_became_peered":"2024-09-19T08:43:13.506495+0000","last_unstale":"2024-09-19T08:43:26.007296+0000","last_undegraded":"2024-09-19T08:43:26.007296+0000","last_fullsized":"2024-09-19T08:43:26.007296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:59.058100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072038+0000","last_change":"2024-09-19T08:43:12.060835+0000","last_active":"2024-09-19T08:43:25.072038+0000","last_peered":"2024-09-19T08:43:25.072038+0000","last_clean":"2024-09-19T08:43:25.072038+0000","last_became_active":"2024-09-19T08:43:12.060376+0000","last_became_peered":"2024-09-19T08:43:12.060376+0000","last_unstale":"2024-09-19T08:43:25.072038+0000","last_undegraded":"2024-09-19T08:43:25.072038+0000","last_fullsized":"2024-09-19T08:43:25.072038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:38.385378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006772+0000","last_change":"2024-09-19T08:43:20.861704+0000","last_active":"2024-09-19T08:43:26.006772+0000","last_peered":"2024-09-19T08:43:26.006772+0000","last_clean":"2024-09-19T08:43:26.006772+0000","last_became_active":"2024-09-19T08:43:20.861209+0000","last_became_peered":"2024-09-19T08:43:20.861209+0000","last_unstale":"2024-09-19T08:43:26.006772+0000","last_undegraded":"2024-09-19T08:43:26.006772+0000","last_fullsized":"2024-09-19T08:43:26.006772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:02.717283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007132+0000","last_change":"2024-09-19T08:43:13.506167+0000","last_active":"2024-09-19T08:43:26.007132+0000","last_peered":"2024-09-19T08:43:26.007132+0000","last_clean":"2024-09-19T08:43:26.007132+0000","last_became_active":"2024-09-19T08:43:13.505771+0000","last_became_peered":"2024-09-19T08:43:13.505771+0000","last_unstale":"2024-09-19T08:43:26.007132+0000","last_undegraded":"2024-09-19T08:43:26.007132+0000","last_fullsized":"2024-09-19T08:43:26.007132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:10.408410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935135+0000","last_change":"2024-09-19T08:43:11.461464+0000","last_active":"2024-09-19T08:43:24.935135+0000","last_peered":"2024-09-19T08:43:24.935135+0000","last_clean":"2024-09-19T08:43:24.935135+0000","last_became_active":"2024-09-19T08:43:11.461109+0000","last_became_peered":"2024-09-19T08:43:11.461109+0000","last_unstale":"2024-09-19T08:43:24.935135+0000","last_undegraded":"2024-09-19T08:43:24.935135+0000","last_fullsized":"2024-09-19T08:43:24.935135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:43.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007347+0000","last_change":"2024-09-19T08:43:20.539703+0000","last_active":"2024-09-19T08:43:26.007347+0000","last_peered":"2024-09-19T08:43:26.007347+0000","last_clean":"2024-09-19T08:43:26.007347+0000","last_became_active":"2024-09-19T08:43:20.538601+0000","last_became_peered":"2024-09-19T08:43:20.538601+0000","last_unstale":"2024-09-19T08:43:26.007347+0000","last_undegraded":"2024-09-19T08:43:26.007347+0000","last_fullsized":"2024-09-19T08:43:26.007347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:09.306293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547797+0000","last_change":"2024-09-19T08:43:13.511861+0000","last_active":"2024-09-19T08:43:23.547797+0000","last_peered":"2024-09-19T08:43:23.547797+0000","last_clean":"2024-09-19T08:43:23.547797+0000","last_became_active":"2024-09-19T08:43:13.511426+0000","last_became_peered":"2024-09-19T08:43:13.511426+0000","last_unstale":"2024-09-19T08:43:23.547797+0000","last_undegraded":"2024-09-19T08:43:23.547797+0000","last_fullsized":"2024-09-19T08:43:23.547797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:06.975135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007040+0000","last_change":"2024-09-19T08:43:12.059704+0000","last_active":"2024-09-19T08:43:26.007040+0000","last_peered":"2024-09-19T08:43:26.007040+0000","last_clean":"2024-09-19T08:43:26.007040+0000","last_became_active":"2024-09-19T08:43:12.059338+0000","last_became_peered":"2024-09-19T08:43:12.059338+0000","last_unstale":"2024-09-19T08:43:26.007040+0000","last_undegraded":"2024-09-19T08:43:26.007040+0000","last_fullsized":"2024-09-19T08:43:26.007040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:03.336909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007123+0000","last_change":"2024-09-19T08:43:20.861308+0000","last_active":"2024-09-19T08:43:26.007123+0000","last_peered":"2024-09-19T08:43:26.007123+0000","last_clean":"2024-09-19T08:43:26.007123+0000","last_became_active":"2024-09-19T08:43:20.860901+0000","last_became_peered":"2024-09-19T08:43:20.860901+0000","last_unstale":"2024-09-19T08:43:26.007123+0000","last_undegraded":"2024-09-19T08:43:26.007123+0000","last_fullsized":"2024-09-19T08:43:26.007123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:15.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006921+0000","last_change":"2024-09-19T08:43:13.501723+0000","last_active":"2024-09-19T08:43:26.006921+0000","last_peered":"2024-09-19T08:43:26.006921+0000","last_clean":"2024-09-19T08:43:26.006921+0000","last_became_active":"2024-09-19T08:43:13.501427+0000","last_became_peered":"2024-09-19T08:43:13.501427+0000","last_unstale":"2024-09-19T08:43:26.006921+0000","last_undegraded":"2024-09-19T08:43:26.006921+0000","last_fullsized":"2024-09-19T08:43:26.006921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:26.870460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934776+0000","last_change":"2024-09-19T08:43:11.462927+0000","last_active":"2024-09-19T08:43:24.934776+0000","last_peered":"2024-09-19T08:43:24.934776+0000","last_clean":"2024-09-19T08:43:24.934776+0000","last_became_active":"2024-09-19T08:43:11.462420+0000","last_became_peered":"2024-09-19T08:43:11.462420+0000","last_unstale":"2024-09-19T08:43:24.934776+0000","last_undegraded":"2024-09-19T08:43:24.934776+0000","last_fullsized":"2024-09-19T08:43:24.934776+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:07.801232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548262+0000","last_change":"2024-09-19T08:43:20.862595+0000","last_active":"2024-09-19T08:43:23.548262+0000","last_peered":"2024-09-19T08:43:23.548262+0000","last_clean":"2024-09-19T08:43:23.548262+0000","last_became_active":"2024-09-19T08:43:20.862143+0000","last_became_peered":"2024-09-19T08:43:20.862143+0000","last_unstale":"2024-09-19T08:43:23.548262+0000","last_undegraded":"2024-09-19T08:43:23.548262+0000","last_fullsized":"2024-09-19T08:43:23.548262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.653517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547707+0000","last_change":"2024-09-19T08:43:13.513129+0000","last_active":"2024-09-19T08:43:23.547707+0000","last_peered":"2024-09-19T08:43:23.547707+0000","last_clean":"2024-09-19T08:43:23.547707+0000","last_became_active":"2024-09-19T08:43:13.512681+0000","last_became_peered":"2024-09-19T08:43:13.512681+0000","last_unstale":"2024-09-19T08:43:23.547707+0000","last_undegraded":"2024-09-19T08:43:23.547707+0000","last_fullsized":"2024-09-19T08:43:23.547707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:50.057369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.598129+0000","last_change":"2024-09-19T08:43:11.461772+0000","last_active":"2024-09-19T08:43:24.598129+0000","last_peered":"2024-09-19T08:43:24.598129+0000","last_clean":"2024-09-19T08:43:24.598129+0000","last_became_active":"2024-09-19T08:43:11.461066+0000","last_became_peered":"2024-09-19T08:43:11.461066+0000","last_unstale":"2024-09-19T08:43:24.598129+0000","last_undegraded":"2024-09-19T08:43:24.598129+0000","last_fullsized":"2024-09-19T08:43:24.598129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:55.360550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934948+0000","last_change":"2024-09-19T08:41:59.671692+0000","last_active":"2024-09-19T08:43:24.934948+0000","last_peered":"2024-09-19T08:43:24.934948+0000","last_clean":"2024-09-19T08:43:24.934948+0000","last_became_active":"2024-09-19T08:41:59.671224+0000","last_became_peered":"2024-09-19T08:41:59.671224+0000","last_unstale":"2024-09-19T08:43:24.934948+0000","last_undegraded":"2024-09-19T08:43:24.934948+0000","last_fullsized":"2024-09-19T08:43:24.934948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_clean_scrub_stamp":"2024-09-19T08:38:34.722787+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:50.768501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935354+0000","last_change":"2024-09-19T08:43:20.545612+0000","last_active":"2024-09-19T08:43:24.935354+0000","last_peered":"2024-09-19T08:43:24.935354+0000","last_clean":"2024-09-19T08:43:24.935354+0000","last_became_active":"2024-09-19T08:43:20.545236+0000","last_became_peered":"2024-09-19T08:43:20.545236+0000","last_unstale":"2024-09-19T08:43:24.935354+0000","last_undegraded":"2024-09-19T08:43:24.935354+0000","last_fullsized":"2024-09-19T08:43:24.935354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:53.972567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935397+0000","last_change":"2024-09-19T08:43:13.514014+0000","last_active":"2024-09-19T08:43:24.935397+0000","last_peered":"2024-09-19T08:43:24.935397+0000","last_clean":"2024-09-19T08:43:24.935397+0000","last_became_active":"2024-09-19T08:43:13.513492+0000","last_became_peered":"2024-09-19T08:43:13.513492+0000","last_unstale":"2024-09-19T08:43:24.935397+0000","last_undegraded":"2024-09-19T08:43:24.935397+0000","last_fullsized":"2024-09-19T08:43:24.935397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:17.914628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930949+0000","last_change":"2024-09-19T08:43:12.059822+0000","last_active":"2024-09-19T08:43:24.930949+0000","last_peered":"2024-09-19T08:43:24.930949+0000","last_clean":"2024-09-19T08:43:24.930949+0000","last_became_active":"2024-09-19T08:43:12.059469+0000","last_became_peered":"2024-09-19T08:43:12.059469+0000","last_unstale":"2024-09-19T08:43:24.930949+0000","last_undegraded":"2024-09-19T08:43:24.930949+0000","last_fullsized":"2024-09-19T08:43:24.930949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:22.283239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547667+0000","last_change":"2024-09-19T08:43:20.533058+0000","last_active":"2024-09-19T08:43:23.547667+0000","last_peered":"2024-09-19T08:43:23.547667+0000","last_clean":"2024-09-19T08:43:23.547667+0000","last_became_active":"2024-09-19T08:43:20.532573+0000","last_became_peered":"2024-09-19T08:43:20.532573+0000","last_unstale":"2024-09-19T08:43:23.547667+0000","last_undegraded":"2024-09-19T08:43:23.547667+0000","last_fullsized":"2024-09-19T08:43:23.547667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:30.449747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935191+0000","last_change":"2024-09-19T08:43:13.507233+0000","last_active":"2024-09-19T08:43:24.935191+0000","last_peered":"2024-09-19T08:43:24.935191+0000","last_clean":"2024-09-19T08:43:24.935191+0000","last_became_active":"2024-09-19T08:43:13.506935+0000","last_became_peered":"2024-09-19T08:43:13.506935+0000","last_unstale":"2024-09-19T08:43:24.935191+0000","last_undegraded":"2024-09-19T08:43:24.935191+0000","last_fullsized":"2024-09-19T08:43:24.935191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.767276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548491+0000","last_change":"2024-09-19T08:43:11.461700+0000","last_active":"2024-09-19T08:43:23.548491+0000","last_peered":"2024-09-19T08:43:23.548491+0000","last_clean":"2024-09-19T08:43:23.548491+0000","last_became_active":"2024-09-19T08:43:11.461340+0000","last_became_peered":"2024-09-19T08:43:11.461340+0000","last_unstale":"2024-09-19T08:43:23.548491+0000","last_undegraded":"2024-09-19T08:43:23.548491+0000","last_fullsized":"2024-09-19T08:43:23.548491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:00.331483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006453+0000","last_change":"2024-09-19T08:43:20.541431+0000","last_active":"2024-09-19T08:43:26.006453+0000","last_peered":"2024-09-19T08:43:26.006453+0000","last_clean":"2024-09-19T08:43:26.006453+0000","last_became_active":"2024-09-19T08:43:20.540990+0000","last_became_peered":"2024-09-19T08:43:20.540990+0000","last_unstale":"2024-09-19T08:43:26.006453+0000","last_undegraded":"2024-09-19T08:43:26.006453+0000","last_fullsized":"2024-09-19T08:43:26.006453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:45.733086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935348+0000","last_change":"2024-09-19T08:43:13.505948+0000","last_active":"2024-09-19T08:43:24.935348+0000","last_peered":"2024-09-19T08:43:24.935348+0000","last_clean":"2024-09-19T08:43:24.935348+0000","last_became_active":"2024-09-19T08:43:13.505600+0000","last_became_peered":"2024-09-19T08:43:13.505600+0000","last_unstale":"2024-09-19T08:43:24.935348+0000","last_undegraded":"2024-09-19T08:43:24.935348+0000","last_fullsized":"2024-09-19T08:43:24.935348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:06.461033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007500+0000","last_change":"2024-09-19T08:43:11.458800+0000","last_active":"2024-09-19T08:43:26.007500+0000","last_peered":"2024-09-19T08:43:26.007500+0000","last_clean":"2024-09-19T08:43:26.007500+0000","last_became_active":"2024-09-19T08:43:11.458455+0000","last_became_peered":"2024-09-19T08:43:11.458455+0000","last_unstale":"2024-09-19T08:43:26.007500+0000","last_undegraded":"2024-09-19T08:43:26.007500+0000","last_fullsized":"2024-09-19T08:43:26.007500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:11.730558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547557+0000","last_change":"2024-09-19T08:43:20.539563+0000","last_active":"2024-09-19T08:43:23.547557+0000","last_peered":"2024-09-19T08:43:23.547557+0000","last_clean":"2024-09-19T08:43:23.547557+0000","last_became_active":"2024-09-19T08:43:20.539164+0000","last_became_peered":"2024-09-19T08:43:20.539164+0000","last_unstale":"2024-09-19T08:43:23.547557+0000","last_undegraded":"2024-09-19T08:43:23.547557+0000","last_fullsized":"2024-09-19T08:43:23.547557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:06.285326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371257+0000","last_change":"2024-09-19T08:43:13.513618+0000","last_active":"2024-09-19T08:43:24.371257+0000","last_peered":"2024-09-19T08:43:24.371257+0000","last_clean":"2024-09-19T08:43:24.371257+0000","last_became_active":"2024-09-19T08:43:13.513281+0000","last_became_peered":"2024-09-19T08:43:13.513281+0000","last_unstale":"2024-09-19T08:43:24.371257+0000","last_undegraded":"2024-09-19T08:43:24.371257+0000","last_fullsized":"2024-09-19T08:43:24.371257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:40.874071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007247+0000","last_change":"2024-09-19T08:43:11.457087+0000","last_active":"2024-09-19T08:43:26.007247+0000","last_peered":"2024-09-19T08:43:26.007247+0000","last_clean":"2024-09-19T08:43:26.007247+0000","last_became_active":"2024-09-19T08:43:11.456687+0000","last_became_peered":"2024-09-19T08:43:11.456687+0000","last_unstale":"2024-09-19T08:43:26.007247+0000","last_undegraded":"2024-09-19T08:43:26.007247+0000","last_fullsized":"2024-09-19T08:43:26.007247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:40.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547719+0000","last_change":"2024-09-19T08:43:20.540740+0000","last_active":"2024-09-19T08:43:23.547719+0000","last_peered":"2024-09-19T08:43:23.547719+0000","last_clean":"2024-09-19T08:43:23.547719+0000","last_became_active":"2024-09-19T08:43:20.540044+0000","last_became_peered":"2024-09-19T08:43:20.540044+0000","last_unstale":"2024-09-19T08:43:23.547719+0000","last_undegraded":"2024-09-19T08:43:23.547719+0000","last_fullsized":"2024-09-19T08:43:23.547719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:11.238259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548037+0000","last_change":"2024-09-19T08:43:13.514193+0000","last_active":"2024-09-19T08:43:23.548037+0000","last_peered":"2024-09-19T08:43:23.548037+0000","last_clean":"2024-09-19T08:43:23.548037+0000","last_became_active":"2024-09-19T08:43:13.513864+0000","last_became_peered":"2024-09-19T08:43:13.513864+0000","last_unstale":"2024-09-19T08:43:23.548037+0000","last_undegraded":"2024-09-19T08:43:23.548037+0000","last_fullsized":"2024-09-19T08:43:23.548037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:15.575162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006669+0000","last_change":"2024-09-19T08:43:12.059836+0000","last_active":"2024-09-19T08:43:26.006669+0000","last_peered":"2024-09-19T08:43:26.006669+0000","last_clean":"2024-09-19T08:43:26.006669+0000","last_became_active":"2024-09-19T08:43:12.059459+0000","last_became_peered":"2024-09-19T08:43:12.059459+0000","last_unstale":"2024-09-19T08:43:26.006669+0000","last_undegraded":"2024-09-19T08:43:26.006669+0000","last_fullsized":"2024-09-19T08:43:26.006669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:53.932649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007491+0000","last_change":"2024-09-19T08:43:20.540919+0000","last_active":"2024-09-19T08:43:26.007491+0000","last_peered":"2024-09-19T08:43:26.007491+0000","last_clean":"2024-09-19T08:43:26.007491+0000","last_became_active":"2024-09-19T08:43:20.540535+0000","last_became_peered":"2024-09-19T08:43:20.540535+0000","last_unstale":"2024-09-19T08:43:26.007491+0000","last_undegraded":"2024-09-19T08:43:26.007491+0000","last_fullsized":"2024-09-19T08:43:26.007491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:32.767025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934701+0000","last_change":"2024-09-19T08:43:13.511693+0000","last_active":"2024-09-19T08:43:24.934701+0000","last_peered":"2024-09-19T08:43:24.934701+0000","last_clean":"2024-09-19T08:43:24.934701+0000","last_became_active":"2024-09-19T08:43:13.511347+0000","last_became_peered":"2024-09-19T08:43:13.511347+0000","last_unstale":"2024-09-19T08:43:24.934701+0000","last_undegraded":"2024-09-19T08:43:24.934701+0000","last_fullsized":"2024-09-19T08:43:24.934701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:22.146900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597617+0000","last_change":"2024-09-19T08:43:11.461514+0000","last_active":"2024-09-19T08:43:24.597617+0000","last_peered":"2024-09-19T08:43:24.597617+0000","last_clean":"2024-09-19T08:43:24.597617+0000","last_became_active":"2024-09-19T08:43:11.461079+0000","last_became_peered":"2024-09-19T08:43:11.461079+0000","last_unstale":"2024-09-19T08:43:24.597617+0000","last_undegraded":"2024-09-19T08:43:24.597617+0000","last_fullsized":"2024-09-19T08:43:24.597617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:10.978243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072134+0000","last_change":"2024-09-19T08:43:20.546834+0000","last_active":"2024-09-19T08:43:25.072134+0000","last_peered":"2024-09-19T08:43:25.072134+0000","last_clean":"2024-09-19T08:43:25.072134+0000","last_became_active":"2024-09-19T08:43:20.545732+0000","last_became_peered":"2024-09-19T08:43:20.545732+0000","last_unstale":"2024-09-19T08:43:25.072134+0000","last_undegraded":"2024-09-19T08:43:25.072134+0000","last_fullsized":"2024-09-19T08:43:25.072134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:56.570928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934979+0000","last_change":"2024-09-19T08:43:13.508295+0000","last_active":"2024-09-19T08:43:24.934979+0000","last_peered":"2024-09-19T08:43:24.934979+0000","last_clean":"2024-09-19T08:43:24.934979+0000","last_became_active":"2024-09-19T08:43:13.507988+0000","last_became_peered":"2024-09-19T08:43:13.507988+0000","last_unstale":"2024-09-19T08:43:24.934979+0000","last_undegraded":"2024-09-19T08:43:24.934979+0000","last_fullsized":"2024-09-19T08:43:24.934979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:33.473262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547918+0000","last_change":"2024-09-19T08:43:11.457965+0000","last_active":"2024-09-19T08:43:23.547918+0000","last_peered":"2024-09-19T08:43:23.547918+0000","last_clean":"2024-09-19T08:43:23.547918+0000","last_became_active":"2024-09-19T08:43:11.456616+0000","last_became_peered":"2024-09-19T08:43:11.456616+0000","last_unstale":"2024-09-19T08:43:23.547918+0000","last_undegraded":"2024-09-19T08:43:23.547918+0000","last_fullsized":"2024-09-19T08:43:23.547918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:17.635896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371082+0000","last_change":"2024-09-19T08:43:20.546848+0000","last_active":"2024-09-19T08:43:24.371082+0000","last_peered":"2024-09-19T08:43:24.371082+0000","last_clean":"2024-09-19T08:43:24.371082+0000","last_became_active":"2024-09-19T08:43:20.546430+0000","last_became_peered":"2024-09-19T08:43:20.546430+0000","last_unstale":"2024-09-19T08:43:24.371082+0000","last_undegraded":"2024-09-19T08:43:24.371082+0000","last_fullsized":"2024-09-19T08:43:24.371082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:39.031339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007156+0000","last_change":"2024-09-19T08:43:13.499817+0000","last_active":"2024-09-19T08:43:26.007156+0000","last_peered":"2024-09-19T08:43:26.007156+0000","last_clean":"2024-09-19T08:43:26.007156+0000","last_became_active":"2024-09-19T08:43:13.499446+0000","last_became_peered":"2024-09-19T08:43:13.499446+0000","last_unstale":"2024-09-19T08:43:26.007156+0000","last_undegraded":"2024-09-19T08:43:26.007156+0000","last_fullsized":"2024-09-19T08:43:26.007156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:04.093262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930712+0000","last_change":"2024-09-19T08:43:11.464099+0000","last_active":"2024-09-19T08:43:24.930712+0000","last_peered":"2024-09-19T08:43:24.930712+0000","last_clean":"2024-09-19T08:43:24.930712+0000","last_became_active":"2024-09-19T08:43:11.463735+0000","last_became_peered":"2024-09-19T08:43:11.463735+0000","last_unstale":"2024-09-19T08:43:24.930712+0000","last_undegraded":"2024-09-19T08:43:24.930712+0000","last_fullsized":"2024-09-19T08:43:24.930712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:10.951239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548236+0000","last_change":"2024-09-19T08:43:20.537810+0000","last_active":"2024-09-19T08:43:23.548236+0000","last_peered":"2024-09-19T08:43:23.548236+0000","last_clean":"2024-09-19T08:43:23.548236+0000","last_became_active":"2024-09-19T08:43:20.537355+0000","last_became_peered":"2024-09-19T08:43:20.537355+0000","last_unstale":"2024-09-19T08:43:23.548236+0000","last_undegraded":"2024-09-19T08:43:23.548236+0000","last_fullsized":"2024-09-19T08:43:23.548236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:55.767023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007046+0000","last_change":"2024-09-19T08:43:13.502536+0000","last_active":"2024-09-19T08:43:26.007046+0000","last_peered":"2024-09-19T08:43:26.007046+0000","last_clean":"2024-09-19T08:43:26.007046+0000","last_became_active":"2024-09-19T08:43:13.500808+0000","last_became_peered":"2024-09-19T08:43:13.500808+0000","last_unstale":"2024-09-19T08:43:26.007046+0000","last_undegraded":"2024-09-19T08:43:26.007046+0000","last_fullsized":"2024-09-19T08:43:26.007046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:51.902896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'24","reported_seq":84,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:44:05.662904+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:44:05.662904+0000","last_peered":"2024-09-19T08:44:05.662904+0000","last_clean":"2024-09-19T08:44:05.662904+0000","last_became_active":"2024-09-19T08:43:11.463756+0000","last_became_peered":"2024-09-19T08:43:11.463756+0000","last_unstale":"2024-09-19T08:44:05.662904+0000","last_undegraded":"2024-09-19T08:44:05.662904+0000","last_fullsized":"2024-09-19T08:44:05.662904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:39.124949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":24,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.071733+0000","last_change":"2024-09-19T08:43:20.546900+0000","last_active":"2024-09-19T08:43:25.071733+0000","last_peered":"2024-09-19T08:43:25.071733+0000","last_clean":"2024-09-19T08:43:25.071733+0000","last_became_active":"2024-09-19T08:43:20.545914+0000","last_became_peered":"2024-09-19T08:43:20.545914+0000","last_unstale":"2024-09-19T08:43:25.071733+0000","last_undegraded":"2024-09-19T08:43:25.071733+0000","last_fullsized":"2024-09-19T08:43:25.071733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:02.842999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547819+0000","last_change":"2024-09-19T08:43:13.510848+0000","last_active":"2024-09-19T08:43:23.547819+0000","last_peered":"2024-09-19T08:43:23.547819+0000","last_clean":"2024-09-19T08:43:23.547819+0000","last_became_active":"2024-09-19T08:43:13.510224+0000","last_became_peered":"2024-09-19T08:43:13.510224+0000","last_unstale":"2024-09-19T08:43:23.547819+0000","last_undegraded":"2024-09-19T08:43:23.547819+0000","last_fullsized":"2024-09-19T08:43:23.547819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:56.113933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548324+0000","last_change":"2024-09-19T08:43:12.061493+0000","last_active":"2024-09-19T08:43:23.548324+0000","last_peered":"2024-09-19T08:43:23.548324+0000","last_clean":"2024-09-19T08:43:23.548324+0000","last_became_active":"2024-09-19T08:43:12.061157+0000","last_became_peered":"2024-09-19T08:43:12.061157+0000","last_unstale":"2024-09-19T08:43:23.548324+0000","last_undegraded":"2024-09-19T08:43:23.548324+0000","last_fullsized":"2024-09-19T08:43:23.548324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:59.542997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597585+0000","last_change":"2024-09-19T08:43:20.546703+0000","last_active":"2024-09-19T08:43:24.597585+0000","last_peered":"2024-09-19T08:43:24.597585+0000","last_clean":"2024-09-19T08:43:24.597585+0000","last_became_active":"2024-09-19T08:43:20.546247+0000","last_became_peered":"2024-09-19T08:43:20.546247+0000","last_unstale":"2024-09-19T08:43:24.597585+0000","last_undegraded":"2024-09-19T08:43:24.597585+0000","last_fullsized":"2024-09-19T08:43:24.597585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:53.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006823+0000","last_change":"2024-09-19T08:43:13.508524+0000","last_active":"2024-09-19T08:43:26.006823+0000","last_peered":"2024-09-19T08:43:26.006823+0000","last_clean":"2024-09-19T08:43:26.006823+0000","last_became_active":"2024-09-19T08:43:13.508213+0000","last_became_peered":"2024-09-19T08:43:13.508213+0000","last_unstale":"2024-09-19T08:43:26.006823+0000","last_undegraded":"2024-09-19T08:43:26.006823+0000","last_fullsized":"2024-09-19T08:43:26.006823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:13.211949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935331+0000","last_change":"2024-09-19T08:43:11.460928+0000","last_active":"2024-09-19T08:43:24.935331+0000","last_peered":"2024-09-19T08:43:24.935331+0000","last_clean":"2024-09-19T08:43:24.935331+0000","last_became_active":"2024-09-19T08:43:11.460555+0000","last_became_peered":"2024-09-19T08:43:11.460555+0000","last_unstale":"2024-09-19T08:43:24.935331+0000","last_undegraded":"2024-09-19T08:43:24.935331+0000","last_fullsized":"2024-09-19T08:43:24.935331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:21.671235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.071524+0000","last_change":"2024-09-19T08:43:20.547775+0000","last_active":"2024-09-19T08:43:25.071524+0000","last_peered":"2024-09-19T08:43:25.071524+0000","last_clean":"2024-09-19T08:43:25.071524+0000","last_became_active":"2024-09-19T08:43:20.547318+0000","last_became_peered":"2024-09-19T08:43:20.547318+0000","last_unstale":"2024-09-19T08:43:25.071524+0000","last_undegraded":"2024-09-19T08:43:25.071524+0000","last_fullsized":"2024-09-19T08:43:25.071524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:14.925314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548148+0000","last_change":"2024-09-19T08:43:13.511510+0000","last_active":"2024-09-19T08:43:23.548148+0000","last_peered":"2024-09-19T08:43:23.548148+0000","last_clean":"2024-09-19T08:43:23.548148+0000","last_became_active":"2024-09-19T08:43:13.511184+0000","last_became_peered":"2024-09-19T08:43:13.511184+0000","last_unstale":"2024-09-19T08:43:23.548148+0000","last_undegraded":"2024-09-19T08:43:23.548148+0000","last_fullsized":"2024-09-19T08:43:23.548148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:23.864506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007510+0000","last_change":"2024-09-19T08:43:11.460981+0000","last_active":"2024-09-19T08:43:26.007510+0000","last_peered":"2024-09-19T08:43:26.007510+0000","last_clean":"2024-09-19T08:43:26.007510+0000","last_became_active":"2024-09-19T08:43:11.460484+0000","last_became_peered":"2024-09-19T08:43:11.460484+0000","last_unstale":"2024-09-19T08:43:26.007510+0000","last_undegraded":"2024-09-19T08:43:26.007510+0000","last_fullsized":"2024-09-19T08:43:26.007510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:35.952469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547236+0000","last_change":"2024-09-19T08:43:20.544626+0000","last_active":"2024-09-19T08:43:23.547236+0000","last_peered":"2024-09-19T08:43:23.547236+0000","last_clean":"2024-09-19T08:43:23.547236+0000","last_became_active":"2024-09-19T08:43:20.543836+0000","last_became_peered":"2024-09-19T08:43:20.543836+0000","last_unstale":"2024-09-19T08:43:23.547236+0000","last_undegraded":"2024-09-19T08:43:23.547236+0000","last_fullsized":"2024-09-19T08:43:23.547236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:17.508084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006485+0000","last_change":"2024-09-19T08:43:20.539467+0000","last_active":"2024-09-19T08:43:26.006485+0000","last_peered":"2024-09-19T08:43:26.006485+0000","last_clean":"2024-09-19T08:43:26.006485+0000","last_became_active":"2024-09-19T08:43:20.539077+0000","last_became_peered":"2024-09-19T08:43:20.539077+0000","last_unstale":"2024-09-19T08:43:26.006485+0000","last_undegraded":"2024-09-19T08:43:26.006485+0000","last_fullsized":"2024-09-19T08:43:26.006485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:10.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.071662+0000","last_change":"2024-09-19T08:43:13.505261+0000","last_active":"2024-09-19T08:43:25.071662+0000","last_peered":"2024-09-19T08:43:25.071662+0000","last_clean":"2024-09-19T08:43:25.071662+0000","last_became_active":"2024-09-19T08:43:13.504984+0000","last_became_peered":"2024-09-19T08:43:13.504984+0000","last_unstale":"2024-09-19T08:43:25.071662+0000","last_undegraded":"2024-09-19T08:43:25.071662+0000","last_fullsized":"2024-09-19T08:43:25.071662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:34.074003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547963+0000","last_change":"2024-09-19T08:43:11.457207+0000","last_active":"2024-09-19T08:43:23.547963+0000","last_peered":"2024-09-19T08:43:23.547963+0000","last_clean":"2024-09-19T08:43:23.547963+0000","last_became_active":"2024-09-19T08:43:11.456827+0000","last_became_peered":"2024-09-19T08:43:11.456827+0000","last_unstale":"2024-09-19T08:43:23.547963+0000","last_undegraded":"2024-09-19T08:43:23.547963+0000","last_fullsized":"2024-09-19T08:43:23.547963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:51.552985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371334+0000","last_change":"2024-09-19T08:43:20.547563+0000","last_active":"2024-09-19T08:43:24.371334+0000","last_peered":"2024-09-19T08:43:24.371334+0000","last_clean":"2024-09-19T08:43:24.371334+0000","last_became_active":"2024-09-19T08:43:20.546909+0000","last_became_peered":"2024-09-19T08:43:20.546909+0000","last_unstale":"2024-09-19T08:43:24.371334+0000","last_undegraded":"2024-09-19T08:43:24.371334+0000","last_fullsized":"2024-09-19T08:43:24.371334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:22.616336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547174+0000","last_change":"2024-09-19T08:43:13.498744+0000","last_active":"2024-09-19T08:43:23.547174+0000","last_peered":"2024-09-19T08:43:23.547174+0000","last_clean":"2024-09-19T08:43:23.547174+0000","last_became_active":"2024-09-19T08:43:13.498459+0000","last_became_peered":"2024-09-19T08:43:13.498459+0000","last_unstale":"2024-09-19T08:43:23.547174+0000","last_undegraded":"2024-09-19T08:43:23.547174+0000","last_fullsized":"2024-09-19T08:43:23.547174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:55.743244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006926+0000","last_change":"2024-09-19T08:43:11.455855+0000","last_active":"2024-09-19T08:43:26.006926+0000","last_peered":"2024-09-19T08:43:26.006926+0000","last_clean":"2024-09-19T08:43:26.006926+0000","last_became_active":"2024-09-19T08:43:11.455450+0000","last_became_peered":"2024-09-19T08:43:11.455450+0000","last_unstale":"2024-09-19T08:43:26.006926+0000","last_undegraded":"2024-09-19T08:43:26.006926+0000","last_fullsized":"2024-09-19T08:43:26.006926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:45.223953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007169+0000","last_change":"2024-09-19T08:43:11.462187+0000","last_active":"2024-09-19T08:43:26.007169+0000","last_peered":"2024-09-19T08:43:26.007169+0000","last_clean":"2024-09-19T08:43:26.007169+0000","last_became_active":"2024-09-19T08:43:11.461820+0000","last_became_peered":"2024-09-19T08:43:11.461820+0000","last_unstale":"2024-09-19T08:43:26.007169+0000","last_undegraded":"2024-09-19T08:43:26.007169+0000","last_fullsized":"2024-09-19T08:43:26.007169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.910058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547896+0000","last_change":"2024-09-19T08:43:13.516825+0000","last_active":"2024-09-19T08:43:23.547896+0000","last_peered":"2024-09-19T08:43:23.547896+0000","last_clean":"2024-09-19T08:43:23.547896+0000","last_became_active":"2024-09-19T08:43:13.516426+0000","last_became_peered":"2024-09-19T08:43:13.516426+0000","last_unstale":"2024-09-19T08:43:23.547896+0000","last_undegraded":"2024-09-19T08:43:23.547896+0000","last_fullsized":"2024-09-19T08:43:23.547896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:31.779517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930730+0000","last_change":"2024-09-19T08:43:20.550696+0000","last_active":"2024-09-19T08:43:24.930730+0000","last_peered":"2024-09-19T08:43:24.930730+0000","last_clean":"2024-09-19T08:43:24.930730+0000","last_became_active":"2024-09-19T08:43:20.550289+0000","last_became_peered":"2024-09-19T08:43:20.550289+0000","last_unstale":"2024-09-19T08:43:24.930730+0000","last_undegraded":"2024-09-19T08:43:24.930730+0000","last_fullsized":"2024-09-19T08:43:24.930730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:57.549540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547908+0000","last_change":"2024-09-19T08:43:11.460452+0000","last_active":"2024-09-19T08:43:23.547908+0000","last_peered":"2024-09-19T08:43:23.547908+0000","last_clean":"2024-09-19T08:43:23.547908+0000","last_became_active":"2024-09-19T08:43:11.460113+0000","last_became_peered":"2024-09-19T08:43:11.460113+0000","last_unstale":"2024-09-19T08:43:23.547908+0000","last_undegraded":"2024-09-19T08:43:23.547908+0000","last_fullsized":"2024-09-19T08:43:23.547908+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:02.112243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006819+0000","last_change":"2024-09-19T08:43:13.506092+0000","last_active":"2024-09-19T08:43:26.006819+0000","last_peered":"2024-09-19T08:43:26.006819+0000","last_clean":"2024-09-19T08:43:26.006819+0000","last_became_active":"2024-09-19T08:43:13.505715+0000","last_became_peered":"2024-09-19T08:43:13.505715+0000","last_unstale":"2024-09-19T08:43:26.006819+0000","last_undegraded":"2024-09-19T08:43:26.006819+0000","last_fullsized":"2024-09-19T08:43:26.006819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:30.256482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930657+0000","last_change":"2024-09-19T08:43:20.540759+0000","last_active":"2024-09-19T08:43:24.930657+0000","last_peered":"2024-09-19T08:43:24.930657+0000","last_clean":"2024-09-19T08:43:24.930657+0000","last_became_active":"2024-09-19T08:43:20.540275+0000","last_became_peered":"2024-09-19T08:43:20.540275+0000","last_unstale":"2024-09-19T08:43:24.930657+0000","last_undegraded":"2024-09-19T08:43:24.930657+0000","last_fullsized":"2024-09-19T08:43:24.930657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:20.032982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.370850+0000","last_change":"2024-09-19T08:43:13.513571+0000","last_active":"2024-09-19T08:43:24.370850+0000","last_peered":"2024-09-19T08:43:24.370850+0000","last_clean":"2024-09-19T08:43:24.370850+0000","last_became_active":"2024-09-19T08:43:13.513239+0000","last_became_peered":"2024-09-19T08:43:13.513239+0000","last_unstale":"2024-09-19T08:43:24.370850+0000","last_undegraded":"2024-09-19T08:43:24.370850+0000","last_fullsized":"2024-09-19T08:43:24.370850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:13.678752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930774+0000","last_change":"2024-09-19T08:43:13.507735+0000","last_active":"2024-09-19T08:43:24.930774+0000","last_peered":"2024-09-19T08:43:24.930774+0000","last_clean":"2024-09-19T08:43:24.930774+0000","last_became_active":"2024-09-19T08:43:13.507279+0000","last_became_peered":"2024-09-19T08:43:13.507279+0000","last_unstale":"2024-09-19T08:43:24.930774+0000","last_undegraded":"2024-09-19T08:43:24.930774+0000","last_fullsized":"2024-09-19T08:43:24.930774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:48.920412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930437+0000","last_change":"2024-09-19T08:43:13.504453+0000","last_active":"2024-09-19T08:43:24.930437+0000","last_peered":"2024-09-19T08:43:24.930437+0000","last_clean":"2024-09-19T08:43:24.930437+0000","last_became_active":"2024-09-19T08:43:13.503985+0000","last_became_peered":"2024-09-19T08:43:13.503985+0000","last_unstale":"2024-09-19T08:43:24.930437+0000","last_undegraded":"2024-09-19T08:43:24.930437+0000","last_fullsized":"2024-09-19T08:43:24.930437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:38.641817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006452+0000","last_change":"2024-09-19T08:43:13.509833+0000","last_active":"2024-09-19T08:43:26.006452+0000","last_peered":"2024-09-19T08:43:26.006452+0000","last_clean":"2024-09-19T08:43:26.006452+0000","last_became_active":"2024-09-19T08:43:13.509523+0000","last_became_peered":"2024-09-19T08:43:13.509523+0000","last_unstale":"2024-09-19T08:43:26.006452+0000","last_undegraded":"2024-09-19T08:43:26.006452+0000","last_fullsized":"2024-09-19T08:43:26.006452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:59.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007403+0000","last_change":"2024-09-19T08:43:13.502624+0000","last_active":"2024-09-19T08:43:26.007403+0000","last_peered":"2024-09-19T08:43:26.007403+0000","last_clean":"2024-09-19T08:43:26.007403+0000","last_became_active":"2024-09-19T08:43:13.502321+0000","last_became_peered":"2024-09-19T08:43:13.502321+0000","last_unstale":"2024-09-19T08:43:26.007403+0000","last_undegraded":"2024-09-19T08:43:26.007403+0000","last_fullsized":"2024-09-19T08:43:26.007403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:41.724026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371275+0000","last_change":"2024-09-19T08:43:13.515261+0000","last_active":"2024-09-19T08:43:24.371275+0000","last_peered":"2024-09-19T08:43:24.371275+0000","last_clean":"2024-09-19T08:43:24.371275+0000","last_became_active":"2024-09-19T08:43:13.514741+0000","last_became_peered":"2024-09-19T08:43:13.514741+0000","last_unstale":"2024-09-19T08:43:24.371275+0000","last_undegraded":"2024-09-19T08:43:24.371275+0000","last_fullsized":"2024-09-19T08:43:24.371275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:16.348859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930963+0000","last_change":"2024-09-19T08:43:13.512820+0000","last_active":"2024-09-19T08:43:24.930963+0000","last_peered":"2024-09-19T08:43:24.930963+0000","last_clean":"2024-09-19T08:43:24.930963+0000","last_became_active":"2024-09-19T08:43:13.512503+0000","last_became_peered":"2024-09-19T08:43:13.512503+0000","last_unstale":"2024-09-19T08:43:24.930963+0000","last_undegraded":"2024-09-19T08:43:24.930963+0000","last_fullsized":"2024-09-19T08:43:24.930963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:41.763855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548002+0000","last_change":"2024-09-19T08:43:13.501837+0000","last_active":"2024-09-19T08:43:23.548002+0000","last_peered":"2024-09-19T08:43:23.548002+0000","last_clean":"2024-09-19T08:43:23.548002+0000","last_became_active":"2024-09-19T08:43:13.501561+0000","last_became_peered":"2024-09-19T08:43:13.501561+0000","last_unstale":"2024-09-19T08:43:23.548002+0000","last_undegraded":"2024-09-19T08:43:23.548002+0000","last_fullsized":"2024-09-19T08:43:23.548002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:30.891617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547641+0000","last_change":"2024-09-19T08:43:13.506755+0000","last_active":"2024-09-19T08:43:23.547641+0000","last_peered":"2024-09-19T08:43:23.547641+0000","last_clean":"2024-09-19T08:43:23.547641+0000","last_became_active":"2024-09-19T08:43:13.506462+0000","last_became_peered":"2024-09-19T08:43:13.506462+0000","last_unstale":"2024-09-19T08:43:23.547641+0000","last_undegraded":"2024-09-19T08:43:23.547641+0000","last_fullsized":"2024-09-19T08:43:23.547641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:37.686741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547205+0000","last_change":"2024-09-19T08:43:13.506407+0000","last_active":"2024-09-19T08:43:23.547205+0000","last_peered":"2024-09-19T08:43:23.547205+0000","last_clean":"2024-09-19T08:43:23.547205+0000","last_became_active":"2024-09-19T08:43:13.506094+0000","last_became_peered":"2024-09-19T08:43:13.506094+0000","last_unstale":"2024-09-19T08:43:23.547205+0000","last_undegraded":"2024-09-19T08:43:23.547205+0000","last_fullsized":"2024-09-19T08:43:23.547205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:40.654865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547777+0000","last_change":"2024-09-19T08:43:13.502542+0000","last_active":"2024-09-19T08:43:23.547777+0000","last_peered":"2024-09-19T08:43:23.547777+0000","last_clean":"2024-09-19T08:43:23.547777+0000","last_became_active":"2024-09-19T08:43:13.502186+0000","last_became_peered":"2024-09-19T08:43:13.502186+0000","last_unstale":"2024-09-19T08:43:23.547777+0000","last_undegraded":"2024-09-19T08:43:23.547777+0000","last_fullsized":"2024-09-19T08:43:23.547777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:18.022089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007151+0000","last_change":"2024-09-19T08:43:13.500097+0000","last_active":"2024-09-19T08:43:26.007151+0000","last_peered":"2024-09-19T08:43:26.007151+0000","last_clean":"2024-09-19T08:43:26.007151+0000","last_became_active":"2024-09-19T08:43:13.499403+0000","last_became_peered":"2024-09-19T08:43:13.499403+0000","last_unstale":"2024-09-19T08:43:26.007151+0000","last_undegraded":"2024-09-19T08:43:26.007151+0000","last_fullsized":"2024-09-19T08:43:26.007151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:29.772783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371034+0000","last_change":"2024-09-19T08:43:13.509855+0000","last_active":"2024-09-19T08:43:24.371034+0000","last_peered":"2024-09-19T08:43:24.371034+0000","last_clean":"2024-09-19T08:43:24.371034+0000","last_became_active":"2024-09-19T08:43:13.509531+0000","last_became_peered":"2024-09-19T08:43:13.509531+0000","last_unstale":"2024-09-19T08:43:24.371034+0000","last_undegraded":"2024-09-19T08:43:24.371034+0000","last_fullsized":"2024-09-19T08:43:24.371034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:47.722940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930845+0000","last_change":"2024-09-19T08:43:13.507443+0000","last_active":"2024-09-19T08:43:24.930845+0000","last_peered":"2024-09-19T08:43:24.930845+0000","last_clean":"2024-09-19T08:43:24.930845+0000","last_became_active":"2024-09-19T08:43:13.505626+0000","last_became_peered":"2024-09-19T08:43:13.505626+0000","last_unstale":"2024-09-19T08:43:24.930845+0000","last_undegraded":"2024-09-19T08:43:24.930845+0000","last_fullsized":"2024-09-19T08:43:24.930845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:27.130768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072064+0000","last_change":"2024-09-19T08:43:13.513796+0000","last_active":"2024-09-19T08:43:25.072064+0000","last_peered":"2024-09-19T08:43:25.072064+0000","last_clean":"2024-09-19T08:43:25.072064+0000","last_became_active":"2024-09-19T08:43:13.513519+0000","last_became_peered":"2024-09-19T08:43:13.513519+0000","last_unstale":"2024-09-19T08:43:25.072064+0000","last_undegraded":"2024-09-19T08:43:25.072064+0000","last_fullsized":"2024-09-19T08:43:25.072064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:32.118184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371448+0000","last_change":"2024-09-19T08:43:13.515267+0000","last_active":"2024-09-19T08:43:24.371448+0000","last_peered":"2024-09-19T08:43:24.371448+0000","last_clean":"2024-09-19T08:43:24.371448+0000","last_became_active":"2024-09-19T08:43:13.514806+0000","last_became_peered":"2024-09-19T08:43:13.514806+0000","last_unstale":"2024-09-19T08:43:24.371448+0000","last_undegraded":"2024-09-19T08:43:24.371448+0000","last_fullsized":"2024-09-19T08:43:24.371448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:10.977591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547401+0000","last_change":"2024-09-19T08:43:13.508047+0000","last_active":"2024-09-19T08:43:23.547401+0000","last_peered":"2024-09-19T08:43:23.547401+0000","last_clean":"2024-09-19T08:43:23.547401+0000","last_became_active":"2024-09-19T08:43:13.505069+0000","last_became_peered":"2024-09-19T08:43:13.505069+0000","last_unstale":"2024-09-19T08:43:23.547401+0000","last_undegraded":"2024-09-19T08:43:23.547401+0000","last_fullsized":"2024-09-19T08:43:23.547401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.321943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006221+0000","last_change":"2024-09-19T08:43:13.510178+0000","last_active":"2024-09-19T08:43:26.006221+0000","last_peered":"2024-09-19T08:43:26.006221+0000","last_clean":"2024-09-19T08:43:26.006221+0000","last_became_active":"2024-09-19T08:43:13.509620+0000","last_became_peered":"2024-09-19T08:43:13.509620+0000","last_unstale":"2024-09-19T08:43:26.006221+0000","last_undegraded":"2024-09-19T08:43:26.006221+0000","last_fullsized":"2024-09-19T08:43:26.006221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:01.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006155+0000","last_change":"2024-09-19T08:43:13.505288+0000","last_active":"2024-09-19T08:43:26.006155+0000","last_peered":"2024-09-19T08:43:26.006155+0000","last_clean":"2024-09-19T08:43:26.006155+0000","last_became_active":"2024-09-19T08:43:13.504813+0000","last_became_peered":"2024-09-19T08:43:13.504813+0000","last_unstale":"2024-09-19T08:43:26.006155+0000","last_undegraded":"2024-09-19T08:43:26.006155+0000","last_fullsized":"2024-09-19T08:43:26.006155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:17.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007145+0000","last_change":"2024-09-19T08:43:13.508392+0000","last_active":"2024-09-19T08:43:26.007145+0000","last_peered":"2024-09-19T08:43:26.007145+0000","last_clean":"2024-09-19T08:43:26.007145+0000","last_became_active":"2024-09-19T08:43:13.507924+0000","last_became_peered":"2024-09-19T08:43:13.507924+0000","last_unstale":"2024-09-19T08:43:26.007145+0000","last_undegraded":"2024-09-19T08:43:26.007145+0000","last_fullsized":"2024-09-19T08:43:26.007145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:41.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.598019+0000","last_change":"2024-09-19T08:43:13.513906+0000","last_active":"2024-09-19T08:43:24.598019+0000","last_peered":"2024-09-19T08:43:24.598019+0000","last_clean":"2024-09-19T08:43:24.598019+0000","last_became_active":"2024-09-19T08:43:13.513570+0000","last_became_peered":"2024-09-19T08:43:13.513570+0000","last_unstale":"2024-09-19T08:43:24.598019+0000","last_undegraded":"2024-09-19T08:43:24.598019+0000","last_fullsized":"2024-09-19T08:43:24.598019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:13.516639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935292+0000","last_change":"2024-09-19T08:43:13.513776+0000","last_active":"2024-09-19T08:43:24.935292+0000","last_peered":"2024-09-19T08:43:24.935292+0000","last_clean":"2024-09-19T08:43:24.935292+0000","last_became_active":"2024-09-19T08:43:13.513087+0000","last_became_peered":"2024-09-19T08:43:13.513087+0000","last_unstale":"2024-09-19T08:43:24.935292+0000","last_undegraded":"2024-09-19T08:43:24.935292+0000","last_fullsized":"2024-09-19T08:43:24.935292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:09.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007612+0000","last_change":"2024-09-19T08:43:13.509904+0000","last_active":"2024-09-19T08:43:26.007612+0000","last_peered":"2024-09-19T08:43:26.007612+0000","last_clean":"2024-09-19T08:43:26.007612+0000","last_became_active":"2024-09-19T08:43:13.509550+0000","last_became_peered":"2024-09-19T08:43:13.509550+0000","last_unstale":"2024-09-19T08:43:26.007612+0000","last_undegraded":"2024-09-19T08:43:26.007612+0000","last_fullsized":"2024-09-19T08:43:26.007612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:05.505592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548081+0000","last_change":"2024-09-19T08:43:13.513825+0000","last_active":"2024-09-19T08:43:23.548081+0000","last_peered":"2024-09-19T08:43:23.548081+0000","last_clean":"2024-09-19T08:43:23.548081+0000","last_became_active":"2024-09-19T08:43:13.513458+0000","last_became_peered":"2024-09-19T08:43:13.513458+0000","last_unstale":"2024-09-19T08:43:23.548081+0000","last_undegraded":"2024-09-19T08:43:23.548081+0000","last_fullsized":"2024-09-19T08:43:23.548081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:22.141180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547082+0000","last_change":"2024-09-19T08:43:13.512512+0000","last_active":"2024-09-19T08:43:23.547082+0000","last_peered":"2024-09-19T08:43:23.547082+0000","last_clean":"2024-09-19T08:43:23.547082+0000","last_became_active":"2024-09-19T08:43:13.512117+0000","last_became_peered":"2024-09-19T08:43:13.512117+0000","last_unstale":"2024-09-19T08:43:23.547082+0000","last_undegraded":"2024-09-19T08:43:23.547082+0000","last_fullsized":"2024-09-19T08:43:23.547082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:05.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934853+0000","last_change":"2024-09-19T08:43:13.510732+0000","last_active":"2024-09-19T08:43:24.934853+0000","last_peered":"2024-09-19T08:43:24.934853+0000","last_clean":"2024-09-19T08:43:24.934853+0000","last_became_active":"2024-09-19T08:43:13.510412+0000","last_became_peered":"2024-09-19T08:43:13.510412+0000","last_unstale":"2024-09-19T08:43:24.934853+0000","last_undegraded":"2024-09-19T08:43:24.934853+0000","last_fullsized":"2024-09-19T08:43:24.934853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:32.057417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007105+0000","last_change":"2024-09-19T08:43:13.509665+0000","last_active":"2024-09-19T08:43:26.007105+0000","last_peered":"2024-09-19T08:43:26.007105+0000","last_clean":"2024-09-19T08:43:26.007105+0000","last_became_active":"2024-09-19T08:43:13.509331+0000","last_became_peered":"2024-09-19T08:43:13.509331+0000","last_unstale":"2024-09-19T08:43:26.007105+0000","last_undegraded":"2024-09-19T08:43:26.007105+0000","last_fullsized":"2024-09-19T08:43:26.007105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:18.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006752+0000","last_change":"2024-09-19T08:43:13.498969+0000","last_active":"2024-09-19T08:43:26.006752+0000","last_peered":"2024-09-19T08:43:26.006752+0000","last_clean":"2024-09-19T08:43:26.006752+0000","last_became_active":"2024-09-19T08:43:13.498274+0000","last_became_peered":"2024-09-19T08:43:13.498274+0000","last_unstale":"2024-09-19T08:43:26.006752+0000","last_undegraded":"2024-09-19T08:43:26.006752+0000","last_fullsized":"2024-09-19T08:43:26.006752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:53.220934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597990+0000","last_change":"2024-09-19T08:43:13.515101+0000","last_active":"2024-09-19T08:43:24.597990+0000","last_peered":"2024-09-19T08:43:24.597990+0000","last_clean":"2024-09-19T08:43:24.597990+0000","last_became_active":"2024-09-19T08:43:13.514476+0000","last_became_peered":"2024-09-19T08:43:13.514476+0000","last_unstale":"2024-09-19T08:43:24.597990+0000","last_undegraded":"2024-09-19T08:43:24.597990+0000","last_fullsized":"2024-09-19T08:43:24.597990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:34.864832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006393+0000","last_change":"2024-09-19T08:43:13.513978+0000","last_active":"2024-09-19T08:43:26.006393+0000","last_peered":"2024-09-19T08:43:26.006393+0000","last_clean":"2024-09-19T08:43:26.006393+0000","last_became_active":"2024-09-19T08:43:13.513644+0000","last_became_peered":"2024-09-19T08:43:13.513644+0000","last_unstale":"2024-09-19T08:43:26.006393+0000","last_undegraded":"2024-09-19T08:43:26.006393+0000","last_fullsized":"2024-09-19T08:43:26.006393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.496383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006624+0000","last_change":"2024-09-19T08:43:13.504697+0000","last_active":"2024-09-19T08:43:26.006624+0000","last_peered":"2024-09-19T08:43:26.006624+0000","last_clean":"2024-09-19T08:43:26.006624+0000","last_became_active":"2024-09-19T08:43:13.504329+0000","last_became_peered":"2024-09-19T08:43:13.504329+0000","last_unstale":"2024-09-19T08:43:26.006624+0000","last_undegraded":"2024-09-19T08:43:26.006624+0000","last_fullsized":"2024-09-19T08:43:26.006624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:54.393292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371446+0000","last_change":"2024-09-19T08:43:13.514793+0000","last_active":"2024-09-19T08:43:24.371446+0000","last_peered":"2024-09-19T08:43:24.371446+0000","last_clean":"2024-09-19T08:43:24.371446+0000","last_became_active":"2024-09-19T08:43:13.514146+0000","last_became_peered":"2024-09-19T08:43:13.514146+0000","last_unstale":"2024-09-19T08:43:24.371446+0000","last_undegraded":"2024-09-19T08:43:24.371446+0000","last_fullsized":"2024-09-19T08:43:24.371446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.616341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49896,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":69,"num_write":73,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":169984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1622016,"data_stored":1112367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972386,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":481481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234022,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":477407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708280,"statfs":{"total":95995035648,"available":95957278720,"internally_reserved":0,"allocated":1564672,"data_stored":1071849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593776,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":958464,"data_stored":472707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1067353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986234,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":476825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":472811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":521839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":521805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":472797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:11.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:11.942 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:11 smithi018 ceph-mon[30956]: pgmap v312: 129 pgs: 129 active+clean; 625 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T08:44:11.942 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:11 smithi018 ceph-mon[30956]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:11.942 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:11 smithi150 ceph-mon[34610]: pgmap v312: 129 pgs: 129 active+clean; 625 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T08:44:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:11 smithi150 ceph-mon[34610]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:11 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:11 smithi162 ceph-mon[34870]: pgmap v312: 129 pgs: 129 active+clean; 625 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T08:44:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:11 smithi162 ceph-mon[34870]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:11 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/540838932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4101420 msgr2=0x7fe2e410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/540838932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4101420 0x7fe2e410d950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009cd0 tx=0x7fe2dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/540838932 shutdown_connections 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/540838932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4101420 0x7fe2e410d950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/540838932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e4100a80 0x7fe2e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/540838932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4106a80 0x7fe2e4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/540838932 >> 172.21.15.18:0/540838932 conn(0x7fe2e40fc7a0 msgr2=0x7fe2e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/540838932 shutdown_connections 2024-09-19T08:44:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.158+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/540838932 wait complete. 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 Processor -- start 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 -- start start 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4100a80 0x7fe2e4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e4101420 0x7fe2e4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 0x7fe2e41a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4110d30 con 0x7fe2e4106a80 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4110bb0 con 0x7fe2e4101420 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e9bfb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4110eb0 con 0x7fe2e4100a80 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 0x7fe2e41a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 0x7fe2e41a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51284/0 (socket says 172.21.15.18:51284) 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.159+0000 7fe2e3fff640 1 -- 172.21.15.18:0/3632363484 learned_addr learned my addr 172.21.15.18:0/3632363484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2dbfff640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e4101420 0x7fe2e4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:12.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e37fe640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4100a80 0x7fe2e4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e3fff640 1 -- 172.21.15.18:0/3632363484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4100a80 msgr2=0x7fe2e4199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e3fff640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4100a80 0x7fe2e4199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e3fff640 1 -- 172.21.15.18:0/3632363484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e4101420 msgr2=0x7fe2e4199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e3fff640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e4101420 0x7fe2e4199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e3fff640 1 -- 172.21.15.18:0/3632363484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e41a46f0 con 0x7fe2e4106a80 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e37fe640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4100a80 0x7fe2e4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e3fff640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 0x7fe2e41a41b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc005cc0 tx=0x7fe2dc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc004450 con 0x7fe2e4106a80 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e41a48c0 con 0x7fe2e4106a80 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2dc031c90 con 0x7fe2e4106a80 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc03b400 con 0x7fe2e4106a80 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.160+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e41a4da0 con 0x7fe2e4106a80 2024-09-19T08:44:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.161+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4100ee0 con 0x7fe2e4106a80 2024-09-19T08:44:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.162+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe2dc004680 con 0x7fe2e4106a80 2024-09-19T08:44:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.163+0000 7fe2e17fa640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2d00a32d0 0x7fe2d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.164+0000 7fe2e37fe640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2d00a32d0 0x7fe2d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.164+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fe2dc02e030 con 0x7fe2e4106a80 2024-09-19T08:44:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.164+0000 7fe2e37fe640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2d00a32d0 0x7fe2d00a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4005e10 tx=0x7fe2d4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.168+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2dc0bd870 con 0x7fe2e4106a80 2024-09-19T08:44:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.345+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2e4109060 con 0x7fe2d00a32d0 2024-09-19T08:44:12.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.353+0000 7fe2e17fa640 1 -- 172.21.15.18:0/3632363484 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340254 (secure 0 0 0) 0x7fe2d400a2b0 con 0x7fe2d00a32d0 2024-09-19T08:44:12.356 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:12.358 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T08:44:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2d00a32d0 msgr2=0x7fe2d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2d00a32d0 0x7fe2d00a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4005e10 tx=0x7fe2d4005da0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 msgr2=0x7fe2e41a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 0x7fe2e41a41b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc005cc0 tx=0x7fe2dc003c20 comp rx=0 tx=0).stop 2024-09-19T08:44:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 shutdown_connections 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe2d00a32d0 0x7fe2d00a5790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e4106a80 0x7fe2e41a41b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2e4101420 0x7fe2e4199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 --2- 172.21.15.18:0/3632363484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2e4100a80 0x7fe2e4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 >> 172.21.15.18:0/3632363484 conn(0x7fe2e40fc7a0 msgr2=0x7fe2e40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 shutdown_connections 2024-09-19T08:44:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:12.357+0000 7fe2e9bfb640 1 -- 172.21.15.18:0/3632363484 wait complete. 2024-09-19T08:44:13.050 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-19T08:44:11.860063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650646,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":173,"num_read_kb":193,"num_write":266,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387460,"kb_used_data":13244,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554364,"statfs":{"total":1151940427776,"available":1151543668736,"internally_reserved":0,"allocated":13561856,"data_stored":7636192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55636,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":71,"num_write":36,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003127"},"pg_stats":[{"pgid":"2.1f","version":"80'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072228+0000","last_change":"2024-09-19T08:43:11.457240+0000","last_active":"2024-09-19T08:43:25.072228+0000","last_peered":"2024-09-19T08:43:25.072228+0000","last_clean":"2024-09-19T08:43:25.072228+0000","last_became_active":"2024-09-19T08:43:11.456921+0000","last_became_peered":"2024-09-19T08:43:11.456921+0000","last_unstale":"2024-09-19T08:43:25.072228+0000","last_undegraded":"2024-09-19T08:43:25.072228+0000","last_fullsized":"2024-09-19T08:43:25.072228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:39.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547351+0000","last_change":"2024-09-19T08:43:13.510724+0000","last_active":"2024-09-19T08:43:23.547351+0000","last_peered":"2024-09-19T08:43:23.547351+0000","last_clean":"2024-09-19T08:43:23.547351+0000","last_became_active":"2024-09-19T08:43:13.506747+0000","last_became_peered":"2024-09-19T08:43:13.506747+0000","last_unstale":"2024-09-19T08:43:23.547351+0000","last_undegraded":"2024-09-19T08:43:23.547351+0000","last_fullsized":"2024-09-19T08:43:23.547351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:07.182413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930409+0000","last_change":"2024-09-19T08:43:20.550571+0000","last_active":"2024-09-19T08:43:24.930409+0000","last_peered":"2024-09-19T08:43:24.930409+0000","last_clean":"2024-09-19T08:43:24.930409+0000","last_became_active":"2024-09-19T08:43:20.550197+0000","last_became_peered":"2024-09-19T08:43:20.550197+0000","last_unstale":"2024-09-19T08:43:24.930409+0000","last_undegraded":"2024-09-19T08:43:24.930409+0000","last_fullsized":"2024-09-19T08:43:24.930409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:52.442760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547814+0000","last_change":"2024-09-19T08:43:12.059489+0000","last_active":"2024-09-19T08:43:23.547814+0000","last_peered":"2024-09-19T08:43:23.547814+0000","last_clean":"2024-09-19T08:43:23.547814+0000","last_became_active":"2024-09-19T08:43:12.059130+0000","last_became_peered":"2024-09-19T08:43:12.059130+0000","last_unstale":"2024-09-19T08:43:23.547814+0000","last_undegraded":"2024-09-19T08:43:23.547814+0000","last_fullsized":"2024-09-19T08:43:23.547814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:09.336149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006787+0000","last_change":"2024-09-19T08:43:13.511634+0000","last_active":"2024-09-19T08:43:26.006787+0000","last_peered":"2024-09-19T08:43:26.006787+0000","last_clean":"2024-09-19T08:43:26.006787+0000","last_became_active":"2024-09-19T08:43:13.510929+0000","last_became_peered":"2024-09-19T08:43:13.510929+0000","last_unstale":"2024-09-19T08:43:26.006787+0000","last_undegraded":"2024-09-19T08:43:26.006787+0000","last_fullsized":"2024-09-19T08:43:26.006787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:30.793265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597372+0000","last_change":"2024-09-19T08:43:20.542072+0000","last_active":"2024-09-19T08:43:24.597372+0000","last_peered":"2024-09-19T08:43:24.597372+0000","last_clean":"2024-09-19T08:43:24.597372+0000","last_became_active":"2024-09-19T08:43:20.541594+0000","last_became_peered":"2024-09-19T08:43:20.541594+0000","last_unstale":"2024-09-19T08:43:24.597372+0000","last_undegraded":"2024-09-19T08:43:24.597372+0000","last_fullsized":"2024-09-19T08:43:24.597372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:03.635376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007186+0000","last_change":"2024-09-19T08:43:11.459663+0000","last_active":"2024-09-19T08:43:26.007186+0000","last_peered":"2024-09-19T08:43:26.007186+0000","last_clean":"2024-09-19T08:43:26.007186+0000","last_became_active":"2024-09-19T08:43:11.459341+0000","last_became_peered":"2024-09-19T08:43:11.459341+0000","last_unstale":"2024-09-19T08:43:26.007186+0000","last_undegraded":"2024-09-19T08:43:26.007186+0000","last_fullsized":"2024-09-19T08:43:26.007186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:55.861085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547847+0000","last_change":"2024-09-19T08:43:13.511108+0000","last_active":"2024-09-19T08:43:23.547847+0000","last_peered":"2024-09-19T08:43:23.547847+0000","last_clean":"2024-09-19T08:43:23.547847+0000","last_became_active":"2024-09-19T08:43:13.510319+0000","last_became_peered":"2024-09-19T08:43:13.510319+0000","last_unstale":"2024-09-19T08:43:23.547847+0000","last_undegraded":"2024-09-19T08:43:23.547847+0000","last_fullsized":"2024-09-19T08:43:23.547847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.119101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597751+0000","last_change":"2024-09-19T08:43:20.541003+0000","last_active":"2024-09-19T08:43:24.597751+0000","last_peered":"2024-09-19T08:43:24.597751+0000","last_clean":"2024-09-19T08:43:24.597751+0000","last_became_active":"2024-09-19T08:43:20.540597+0000","last_became_peered":"2024-09-19T08:43:20.540597+0000","last_unstale":"2024-09-19T08:43:24.597751+0000","last_undegraded":"2024-09-19T08:43:24.597751+0000","last_fullsized":"2024-09-19T08:43:24.597751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:11.553758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007176+0000","last_change":"2024-09-19T08:43:11.460680+0000","last_active":"2024-09-19T08:43:26.007176+0000","last_peered":"2024-09-19T08:43:26.007176+0000","last_clean":"2024-09-19T08:43:26.007176+0000","last_became_active":"2024-09-19T08:43:11.460335+0000","last_became_peered":"2024-09-19T08:43:11.460335+0000","last_unstale":"2024-09-19T08:43:26.007176+0000","last_undegraded":"2024-09-19T08:43:26.007176+0000","last_fullsized":"2024-09-19T08:43:26.007176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:51.332244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548168+0000","last_change":"2024-09-19T08:43:13.514161+0000","last_active":"2024-09-19T08:43:23.548168+0000","last_peered":"2024-09-19T08:43:23.548168+0000","last_clean":"2024-09-19T08:43:23.548168+0000","last_became_active":"2024-09-19T08:43:13.513674+0000","last_became_peered":"2024-09-19T08:43:13.513674+0000","last_unstale":"2024-09-19T08:43:23.548168+0000","last_undegraded":"2024-09-19T08:43:23.548168+0000","last_fullsized":"2024-09-19T08:43:23.548168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:15.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597514+0000","last_change":"2024-09-19T08:43:20.543781+0000","last_active":"2024-09-19T08:43:24.597514+0000","last_peered":"2024-09-19T08:43:24.597514+0000","last_clean":"2024-09-19T08:43:24.597514+0000","last_became_active":"2024-09-19T08:43:20.543476+0000","last_became_peered":"2024-09-19T08:43:20.543476+0000","last_unstale":"2024-09-19T08:43:24.597514+0000","last_undegraded":"2024-09-19T08:43:24.597514+0000","last_fullsized":"2024-09-19T08:43:24.597514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:27.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934961+0000","last_change":"2024-09-19T08:43:13.512711+0000","last_active":"2024-09-19T08:43:24.934961+0000","last_peered":"2024-09-19T08:43:24.934961+0000","last_clean":"2024-09-19T08:43:24.934961+0000","last_became_active":"2024-09-19T08:43:13.512406+0000","last_became_peered":"2024-09-19T08:43:13.512406+0000","last_unstale":"2024-09-19T08:43:24.934961+0000","last_undegraded":"2024-09-19T08:43:24.934961+0000","last_fullsized":"2024-09-19T08:43:24.934961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:23.765966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006919+0000","last_change":"2024-09-19T08:43:11.460442+0000","last_active":"2024-09-19T08:43:26.006919+0000","last_peered":"2024-09-19T08:43:26.006919+0000","last_clean":"2024-09-19T08:43:26.006919+0000","last_became_active":"2024-09-19T08:43:11.460113+0000","last_became_peered":"2024-09-19T08:43:11.460113+0000","last_unstale":"2024-09-19T08:43:26.006919+0000","last_undegraded":"2024-09-19T08:43:26.006919+0000","last_fullsized":"2024-09-19T08:43:26.006919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:29.528307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597874+0000","last_change":"2024-09-19T08:43:20.861786+0000","last_active":"2024-09-19T08:43:24.597874+0000","last_peered":"2024-09-19T08:43:24.597874+0000","last_clean":"2024-09-19T08:43:24.597874+0000","last_became_active":"2024-09-19T08:43:20.861281+0000","last_became_peered":"2024-09-19T08:43:20.861281+0000","last_unstale":"2024-09-19T08:43:24.597874+0000","last_undegraded":"2024-09-19T08:43:24.597874+0000","last_fullsized":"2024-09-19T08:43:24.597874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:47.336930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547358+0000","last_change":"2024-09-19T08:43:13.506879+0000","last_active":"2024-09-19T08:43:23.547358+0000","last_peered":"2024-09-19T08:43:23.547358+0000","last_clean":"2024-09-19T08:43:23.547358+0000","last_became_active":"2024-09-19T08:43:13.506568+0000","last_became_peered":"2024-09-19T08:43:13.506568+0000","last_unstale":"2024-09-19T08:43:23.547358+0000","last_undegraded":"2024-09-19T08:43:23.547358+0000","last_fullsized":"2024-09-19T08:43:23.547358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:50.324234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930420+0000","last_change":"2024-09-19T08:43:11.458197+0000","last_active":"2024-09-19T08:43:24.930420+0000","last_peered":"2024-09-19T08:43:24.930420+0000","last_clean":"2024-09-19T08:43:24.930420+0000","last_became_active":"2024-09-19T08:43:11.457591+0000","last_became_peered":"2024-09-19T08:43:11.457591+0000","last_unstale":"2024-09-19T08:43:24.930420+0000","last_undegraded":"2024-09-19T08:43:24.930420+0000","last_fullsized":"2024-09-19T08:43:24.930420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:05.965594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597873+0000","last_change":"2024-09-19T08:43:20.541453+0000","last_active":"2024-09-19T08:43:24.597873+0000","last_peered":"2024-09-19T08:43:24.597873+0000","last_clean":"2024-09-19T08:43:24.597873+0000","last_became_active":"2024-09-19T08:43:20.541014+0000","last_became_peered":"2024-09-19T08:43:20.541014+0000","last_unstale":"2024-09-19T08:43:24.597873+0000","last_undegraded":"2024-09-19T08:43:24.597873+0000","last_fullsized":"2024-09-19T08:43:24.597873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.373513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.370962+0000","last_change":"2024-09-19T08:43:13.508404+0000","last_active":"2024-09-19T08:43:24.370962+0000","last_peered":"2024-09-19T08:43:24.370962+0000","last_clean":"2024-09-19T08:43:24.370962+0000","last_became_active":"2024-09-19T08:43:13.508018+0000","last_became_peered":"2024-09-19T08:43:13.508018+0000","last_unstale":"2024-09-19T08:43:24.370962+0000","last_undegraded":"2024-09-19T08:43:24.370962+0000","last_fullsized":"2024-09-19T08:43:24.370962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:43.795388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547346+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:43:23.547346+0000","last_peered":"2024-09-19T08:43:23.547346+0000","last_clean":"2024-09-19T08:43:23.547346+0000","last_became_active":"2024-09-19T08:43:11.463696+0000","last_became_peered":"2024-09-19T08:43:11.463696+0000","last_unstale":"2024-09-19T08:43:23.547346+0000","last_undegraded":"2024-09-19T08:43:23.547346+0000","last_fullsized":"2024-09-19T08:43:23.547346+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:18.658727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072087+0000","last_change":"2024-09-19T08:43:20.547619+0000","last_active":"2024-09-19T08:43:25.072087+0000","last_peered":"2024-09-19T08:43:25.072087+0000","last_clean":"2024-09-19T08:43:25.072087+0000","last_became_active":"2024-09-19T08:43:20.547229+0000","last_became_peered":"2024-09-19T08:43:20.547229+0000","last_unstale":"2024-09-19T08:43:25.072087+0000","last_undegraded":"2024-09-19T08:43:25.072087+0000","last_fullsized":"2024-09-19T08:43:25.072087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:21.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006676+0000","last_change":"2024-09-19T08:43:13.501280+0000","last_active":"2024-09-19T08:43:26.006676+0000","last_peered":"2024-09-19T08:43:26.006676+0000","last_clean":"2024-09-19T08:43:26.006676+0000","last_became_active":"2024-09-19T08:43:13.500951+0000","last_became_peered":"2024-09-19T08:43:13.500951+0000","last_unstale":"2024-09-19T08:43:26.006676+0000","last_undegraded":"2024-09-19T08:43:26.006676+0000","last_fullsized":"2024-09-19T08:43:26.006676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:32.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547541+0000","last_change":"2024-09-19T08:43:12.059831+0000","last_active":"2024-09-19T08:43:23.547541+0000","last_peered":"2024-09-19T08:43:23.547541+0000","last_clean":"2024-09-19T08:43:23.547541+0000","last_became_active":"2024-09-19T08:43:12.059476+0000","last_became_peered":"2024-09-19T08:43:12.059476+0000","last_unstale":"2024-09-19T08:43:23.547541+0000","last_undegraded":"2024-09-19T08:43:23.547541+0000","last_fullsized":"2024-09-19T08:43:23.547541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:07.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597930+0000","last_change":"2024-09-19T08:43:20.862549+0000","last_active":"2024-09-19T08:43:24.597930+0000","last_peered":"2024-09-19T08:43:24.597930+0000","last_clean":"2024-09-19T08:43:24.597930+0000","last_became_active":"2024-09-19T08:43:20.862132+0000","last_became_peered":"2024-09-19T08:43:20.862132+0000","last_unstale":"2024-09-19T08:43:24.597930+0000","last_undegraded":"2024-09-19T08:43:24.597930+0000","last_fullsized":"2024-09-19T08:43:24.597930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:21.979379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006616+0000","last_change":"2024-09-19T08:43:13.501448+0000","last_active":"2024-09-19T08:43:26.006616+0000","last_peered":"2024-09-19T08:43:26.006616+0000","last_clean":"2024-09-19T08:43:26.006616+0000","last_became_active":"2024-09-19T08:43:13.501037+0000","last_became_peered":"2024-09-19T08:43:13.501037+0000","last_unstale":"2024-09-19T08:43:26.006616+0000","last_undegraded":"2024-09-19T08:43:26.006616+0000","last_fullsized":"2024-09-19T08:43:26.006616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:55.190450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.598146+0000","last_change":"2024-09-19T08:43:11.512783+0000","last_active":"2024-09-19T08:43:24.598146+0000","last_peered":"2024-09-19T08:43:24.598146+0000","last_clean":"2024-09-19T08:43:24.598146+0000","last_became_active":"2024-09-19T08:43:11.512396+0000","last_became_peered":"2024-09-19T08:43:11.512396+0000","last_unstale":"2024-09-19T08:43:24.598146+0000","last_undegraded":"2024-09-19T08:43:24.598146+0000","last_fullsized":"2024-09-19T08:43:24.598146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.113193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930652+0000","last_change":"2024-09-19T08:43:20.539200+0000","last_active":"2024-09-19T08:43:24.930652+0000","last_peered":"2024-09-19T08:43:24.930652+0000","last_clean":"2024-09-19T08:43:24.930652+0000","last_became_active":"2024-09-19T08:43:20.538778+0000","last_became_peered":"2024-09-19T08:43:20.538778+0000","last_unstale":"2024-09-19T08:43:24.930652+0000","last_undegraded":"2024-09-19T08:43:24.930652+0000","last_fullsized":"2024-09-19T08:43:24.930652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:27.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548055+0000","last_change":"2024-09-19T08:43:13.505769+0000","last_active":"2024-09-19T08:43:23.548055+0000","last_peered":"2024-09-19T08:43:23.548055+0000","last_clean":"2024-09-19T08:43:23.548055+0000","last_became_active":"2024-09-19T08:43:13.503276+0000","last_became_peered":"2024-09-19T08:43:13.503276+0000","last_unstale":"2024-09-19T08:43:23.548055+0000","last_undegraded":"2024-09-19T08:43:23.548055+0000","last_fullsized":"2024-09-19T08:43:23.548055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:58.137325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:44:08.526978+0000","last_change":"2024-09-19T08:43:11.453959+0000","last_active":"2024-09-19T08:44:08.526978+0000","last_peered":"2024-09-19T08:44:08.526978+0000","last_clean":"2024-09-19T08:44:08.526978+0000","last_became_active":"2024-09-19T08:43:11.453645+0000","last_became_peered":"2024-09-19T08:43:11.453645+0000","last_unstale":"2024-09-19T08:44:08.526978+0000","last_undegraded":"2024-09-19T08:44:08.526978+0000","last_fullsized":"2024-09-19T08:44:08.526978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:30.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547086+0000","last_change":"2024-09-19T08:43:20.861812+0000","last_active":"2024-09-19T08:43:23.547086+0000","last_peered":"2024-09-19T08:43:23.547086+0000","last_clean":"2024-09-19T08:43:23.547086+0000","last_became_active":"2024-09-19T08:43:20.861180+0000","last_became_peered":"2024-09-19T08:43:20.861180+0000","last_unstale":"2024-09-19T08:43:23.547086+0000","last_undegraded":"2024-09-19T08:43:23.547086+0000","last_fullsized":"2024-09-19T08:43:23.547086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:24.200250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007456+0000","last_change":"2024-09-19T08:43:13.500991+0000","last_active":"2024-09-19T08:43:26.007456+0000","last_peered":"2024-09-19T08:43:26.007456+0000","last_clean":"2024-09-19T08:43:26.007456+0000","last_became_active":"2024-09-19T08:43:13.500676+0000","last_became_peered":"2024-09-19T08:43:13.500676+0000","last_unstale":"2024-09-19T08:43:26.007456+0000","last_undegraded":"2024-09-19T08:43:26.007456+0000","last_fullsized":"2024-09-19T08:43:26.007456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:38.201131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007197+0000","last_change":"2024-09-19T08:43:12.059273+0000","last_active":"2024-09-19T08:43:26.007197+0000","last_peered":"2024-09-19T08:43:26.007197+0000","last_clean":"2024-09-19T08:43:26.007197+0000","last_became_active":"2024-09-19T08:43:12.058873+0000","last_became_peered":"2024-09-19T08:43:12.058873+0000","last_unstale":"2024-09-19T08:43:26.007197+0000","last_undegraded":"2024-09-19T08:43:26.007197+0000","last_fullsized":"2024-09-19T08:43:26.007197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:43.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371059+0000","last_change":"2024-09-19T08:43:20.543459+0000","last_active":"2024-09-19T08:43:24.371059+0000","last_peered":"2024-09-19T08:43:24.371059+0000","last_clean":"2024-09-19T08:43:24.371059+0000","last_became_active":"2024-09-19T08:43:20.542946+0000","last_became_peered":"2024-09-19T08:43:20.542946+0000","last_unstale":"2024-09-19T08:43:24.371059+0000","last_undegraded":"2024-09-19T08:43:24.371059+0000","last_fullsized":"2024-09-19T08:43:24.371059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:19.423576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007296+0000","last_change":"2024-09-19T08:43:13.506844+0000","last_active":"2024-09-19T08:43:26.007296+0000","last_peered":"2024-09-19T08:43:26.007296+0000","last_clean":"2024-09-19T08:43:26.007296+0000","last_became_active":"2024-09-19T08:43:13.506495+0000","last_became_peered":"2024-09-19T08:43:13.506495+0000","last_unstale":"2024-09-19T08:43:26.007296+0000","last_undegraded":"2024-09-19T08:43:26.007296+0000","last_fullsized":"2024-09-19T08:43:26.007296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:59.058100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072038+0000","last_change":"2024-09-19T08:43:12.060835+0000","last_active":"2024-09-19T08:43:25.072038+0000","last_peered":"2024-09-19T08:43:25.072038+0000","last_clean":"2024-09-19T08:43:25.072038+0000","last_became_active":"2024-09-19T08:43:12.060376+0000","last_became_peered":"2024-09-19T08:43:12.060376+0000","last_unstale":"2024-09-19T08:43:25.072038+0000","last_undegraded":"2024-09-19T08:43:25.072038+0000","last_fullsized":"2024-09-19T08:43:25.072038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:38.385378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006772+0000","last_change":"2024-09-19T08:43:20.861704+0000","last_active":"2024-09-19T08:43:26.006772+0000","last_peered":"2024-09-19T08:43:26.006772+0000","last_clean":"2024-09-19T08:43:26.006772+0000","last_became_active":"2024-09-19T08:43:20.861209+0000","last_became_peered":"2024-09-19T08:43:20.861209+0000","last_unstale":"2024-09-19T08:43:26.006772+0000","last_undegraded":"2024-09-19T08:43:26.006772+0000","last_fullsized":"2024-09-19T08:43:26.006772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:02.717283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007132+0000","last_change":"2024-09-19T08:43:13.506167+0000","last_active":"2024-09-19T08:43:26.007132+0000","last_peered":"2024-09-19T08:43:26.007132+0000","last_clean":"2024-09-19T08:43:26.007132+0000","last_became_active":"2024-09-19T08:43:13.505771+0000","last_became_peered":"2024-09-19T08:43:13.505771+0000","last_unstale":"2024-09-19T08:43:26.007132+0000","last_undegraded":"2024-09-19T08:43:26.007132+0000","last_fullsized":"2024-09-19T08:43:26.007132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:10.408410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935135+0000","last_change":"2024-09-19T08:43:11.461464+0000","last_active":"2024-09-19T08:43:24.935135+0000","last_peered":"2024-09-19T08:43:24.935135+0000","last_clean":"2024-09-19T08:43:24.935135+0000","last_became_active":"2024-09-19T08:43:11.461109+0000","last_became_peered":"2024-09-19T08:43:11.461109+0000","last_unstale":"2024-09-19T08:43:24.935135+0000","last_undegraded":"2024-09-19T08:43:24.935135+0000","last_fullsized":"2024-09-19T08:43:24.935135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:43.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007347+0000","last_change":"2024-09-19T08:43:20.539703+0000","last_active":"2024-09-19T08:43:26.007347+0000","last_peered":"2024-09-19T08:43:26.007347+0000","last_clean":"2024-09-19T08:43:26.007347+0000","last_became_active":"2024-09-19T08:43:20.538601+0000","last_became_peered":"2024-09-19T08:43:20.538601+0000","last_unstale":"2024-09-19T08:43:26.007347+0000","last_undegraded":"2024-09-19T08:43:26.007347+0000","last_fullsized":"2024-09-19T08:43:26.007347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:09.306293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547797+0000","last_change":"2024-09-19T08:43:13.511861+0000","last_active":"2024-09-19T08:43:23.547797+0000","last_peered":"2024-09-19T08:43:23.547797+0000","last_clean":"2024-09-19T08:43:23.547797+0000","last_became_active":"2024-09-19T08:43:13.511426+0000","last_became_peered":"2024-09-19T08:43:13.511426+0000","last_unstale":"2024-09-19T08:43:23.547797+0000","last_undegraded":"2024-09-19T08:43:23.547797+0000","last_fullsized":"2024-09-19T08:43:23.547797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:06.975135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007040+0000","last_change":"2024-09-19T08:43:12.059704+0000","last_active":"2024-09-19T08:43:26.007040+0000","last_peered":"2024-09-19T08:43:26.007040+0000","last_clean":"2024-09-19T08:43:26.007040+0000","last_became_active":"2024-09-19T08:43:12.059338+0000","last_became_peered":"2024-09-19T08:43:12.059338+0000","last_unstale":"2024-09-19T08:43:26.007040+0000","last_undegraded":"2024-09-19T08:43:26.007040+0000","last_fullsized":"2024-09-19T08:43:26.007040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:03.336909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007123+0000","last_change":"2024-09-19T08:43:20.861308+0000","last_active":"2024-09-19T08:43:26.007123+0000","last_peered":"2024-09-19T08:43:26.007123+0000","last_clean":"2024-09-19T08:43:26.007123+0000","last_became_active":"2024-09-19T08:43:20.860901+0000","last_became_peered":"2024-09-19T08:43:20.860901+0000","last_unstale":"2024-09-19T08:43:26.007123+0000","last_undegraded":"2024-09-19T08:43:26.007123+0000","last_fullsized":"2024-09-19T08:43:26.007123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:15.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006921+0000","last_change":"2024-09-19T08:43:13.501723+0000","last_active":"2024-09-19T08:43:26.006921+0000","last_peered":"2024-09-19T08:43:26.006921+0000","last_clean":"2024-09-19T08:43:26.006921+0000","last_became_active":"2024-09-19T08:43:13.501427+0000","last_became_peered":"2024-09-19T08:43:13.501427+0000","last_unstale":"2024-09-19T08:43:26.006921+0000","last_undegraded":"2024-09-19T08:43:26.006921+0000","last_fullsized":"2024-09-19T08:43:26.006921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:26.870460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934776+0000","last_change":"2024-09-19T08:43:11.462927+0000","last_active":"2024-09-19T08:43:24.934776+0000","last_peered":"2024-09-19T08:43:24.934776+0000","last_clean":"2024-09-19T08:43:24.934776+0000","last_became_active":"2024-09-19T08:43:11.462420+0000","last_became_peered":"2024-09-19T08:43:11.462420+0000","last_unstale":"2024-09-19T08:43:24.934776+0000","last_undegraded":"2024-09-19T08:43:24.934776+0000","last_fullsized":"2024-09-19T08:43:24.934776+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:07.801232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548262+0000","last_change":"2024-09-19T08:43:20.862595+0000","last_active":"2024-09-19T08:43:23.548262+0000","last_peered":"2024-09-19T08:43:23.548262+0000","last_clean":"2024-09-19T08:43:23.548262+0000","last_became_active":"2024-09-19T08:43:20.862143+0000","last_became_peered":"2024-09-19T08:43:20.862143+0000","last_unstale":"2024-09-19T08:43:23.548262+0000","last_undegraded":"2024-09-19T08:43:23.548262+0000","last_fullsized":"2024-09-19T08:43:23.548262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.653517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547707+0000","last_change":"2024-09-19T08:43:13.513129+0000","last_active":"2024-09-19T08:43:23.547707+0000","last_peered":"2024-09-19T08:43:23.547707+0000","last_clean":"2024-09-19T08:43:23.547707+0000","last_became_active":"2024-09-19T08:43:13.512681+0000","last_became_peered":"2024-09-19T08:43:13.512681+0000","last_unstale":"2024-09-19T08:43:23.547707+0000","last_undegraded":"2024-09-19T08:43:23.547707+0000","last_fullsized":"2024-09-19T08:43:23.547707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:50.057369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.598129+0000","last_change":"2024-09-19T08:43:11.461772+0000","last_active":"2024-09-19T08:43:24.598129+0000","last_peered":"2024-09-19T08:43:24.598129+0000","last_clean":"2024-09-19T08:43:24.598129+0000","last_became_active":"2024-09-19T08:43:11.461066+0000","last_became_peered":"2024-09-19T08:43:11.461066+0000","last_unstale":"2024-09-19T08:43:24.598129+0000","last_undegraded":"2024-09-19T08:43:24.598129+0000","last_fullsized":"2024-09-19T08:43:24.598129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:55.360550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934948+0000","last_change":"2024-09-19T08:41:59.671692+0000","last_active":"2024-09-19T08:43:24.934948+0000","last_peered":"2024-09-19T08:43:24.934948+0000","last_clean":"2024-09-19T08:43:24.934948+0000","last_became_active":"2024-09-19T08:41:59.671224+0000","last_became_peered":"2024-09-19T08:41:59.671224+0000","last_unstale":"2024-09-19T08:43:24.934948+0000","last_undegraded":"2024-09-19T08:43:24.934948+0000","last_fullsized":"2024-09-19T08:43:24.934948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_clean_scrub_stamp":"2024-09-19T08:38:34.722787+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:50.768501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935354+0000","last_change":"2024-09-19T08:43:20.545612+0000","last_active":"2024-09-19T08:43:24.935354+0000","last_peered":"2024-09-19T08:43:24.935354+0000","last_clean":"2024-09-19T08:43:24.935354+0000","last_became_active":"2024-09-19T08:43:20.545236+0000","last_became_peered":"2024-09-19T08:43:20.545236+0000","last_unstale":"2024-09-19T08:43:24.935354+0000","last_undegraded":"2024-09-19T08:43:24.935354+0000","last_fullsized":"2024-09-19T08:43:24.935354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:53.972567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935397+0000","last_change":"2024-09-19T08:43:13.514014+0000","last_active":"2024-09-19T08:43:24.935397+0000","last_peered":"2024-09-19T08:43:24.935397+0000","last_clean":"2024-09-19T08:43:24.935397+0000","last_became_active":"2024-09-19T08:43:13.513492+0000","last_became_peered":"2024-09-19T08:43:13.513492+0000","last_unstale":"2024-09-19T08:43:24.935397+0000","last_undegraded":"2024-09-19T08:43:24.935397+0000","last_fullsized":"2024-09-19T08:43:24.935397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:17.914628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930949+0000","last_change":"2024-09-19T08:43:12.059822+0000","last_active":"2024-09-19T08:43:24.930949+0000","last_peered":"2024-09-19T08:43:24.930949+0000","last_clean":"2024-09-19T08:43:24.930949+0000","last_became_active":"2024-09-19T08:43:12.059469+0000","last_became_peered":"2024-09-19T08:43:12.059469+0000","last_unstale":"2024-09-19T08:43:24.930949+0000","last_undegraded":"2024-09-19T08:43:24.930949+0000","last_fullsized":"2024-09-19T08:43:24.930949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:22.283239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547667+0000","last_change":"2024-09-19T08:43:20.533058+0000","last_active":"2024-09-19T08:43:23.547667+0000","last_peered":"2024-09-19T08:43:23.547667+0000","last_clean":"2024-09-19T08:43:23.547667+0000","last_became_active":"2024-09-19T08:43:20.532573+0000","last_became_peered":"2024-09-19T08:43:20.532573+0000","last_unstale":"2024-09-19T08:43:23.547667+0000","last_undegraded":"2024-09-19T08:43:23.547667+0000","last_fullsized":"2024-09-19T08:43:23.547667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:30.449747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935191+0000","last_change":"2024-09-19T08:43:13.507233+0000","last_active":"2024-09-19T08:43:24.935191+0000","last_peered":"2024-09-19T08:43:24.935191+0000","last_clean":"2024-09-19T08:43:24.935191+0000","last_became_active":"2024-09-19T08:43:13.506935+0000","last_became_peered":"2024-09-19T08:43:13.506935+0000","last_unstale":"2024-09-19T08:43:24.935191+0000","last_undegraded":"2024-09-19T08:43:24.935191+0000","last_fullsized":"2024-09-19T08:43:24.935191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.767276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548491+0000","last_change":"2024-09-19T08:43:11.461700+0000","last_active":"2024-09-19T08:43:23.548491+0000","last_peered":"2024-09-19T08:43:23.548491+0000","last_clean":"2024-09-19T08:43:23.548491+0000","last_became_active":"2024-09-19T08:43:11.461340+0000","last_became_peered":"2024-09-19T08:43:11.461340+0000","last_unstale":"2024-09-19T08:43:23.548491+0000","last_undegraded":"2024-09-19T08:43:23.548491+0000","last_fullsized":"2024-09-19T08:43:23.548491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:00.331483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006453+0000","last_change":"2024-09-19T08:43:20.541431+0000","last_active":"2024-09-19T08:43:26.006453+0000","last_peered":"2024-09-19T08:43:26.006453+0000","last_clean":"2024-09-19T08:43:26.006453+0000","last_became_active":"2024-09-19T08:43:20.540990+0000","last_became_peered":"2024-09-19T08:43:20.540990+0000","last_unstale":"2024-09-19T08:43:26.006453+0000","last_undegraded":"2024-09-19T08:43:26.006453+0000","last_fullsized":"2024-09-19T08:43:26.006453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:45.733086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935348+0000","last_change":"2024-09-19T08:43:13.505948+0000","last_active":"2024-09-19T08:43:24.935348+0000","last_peered":"2024-09-19T08:43:24.935348+0000","last_clean":"2024-09-19T08:43:24.935348+0000","last_became_active":"2024-09-19T08:43:13.505600+0000","last_became_peered":"2024-09-19T08:43:13.505600+0000","last_unstale":"2024-09-19T08:43:24.935348+0000","last_undegraded":"2024-09-19T08:43:24.935348+0000","last_fullsized":"2024-09-19T08:43:24.935348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:06.461033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007500+0000","last_change":"2024-09-19T08:43:11.458800+0000","last_active":"2024-09-19T08:43:26.007500+0000","last_peered":"2024-09-19T08:43:26.007500+0000","last_clean":"2024-09-19T08:43:26.007500+0000","last_became_active":"2024-09-19T08:43:11.458455+0000","last_became_peered":"2024-09-19T08:43:11.458455+0000","last_unstale":"2024-09-19T08:43:26.007500+0000","last_undegraded":"2024-09-19T08:43:26.007500+0000","last_fullsized":"2024-09-19T08:43:26.007500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:11.730558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547557+0000","last_change":"2024-09-19T08:43:20.539563+0000","last_active":"2024-09-19T08:43:23.547557+0000","last_peered":"2024-09-19T08:43:23.547557+0000","last_clean":"2024-09-19T08:43:23.547557+0000","last_became_active":"2024-09-19T08:43:20.539164+0000","last_became_peered":"2024-09-19T08:43:20.539164+0000","last_unstale":"2024-09-19T08:43:23.547557+0000","last_undegraded":"2024-09-19T08:43:23.547557+0000","last_fullsized":"2024-09-19T08:43:23.547557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:06.285326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371257+0000","last_change":"2024-09-19T08:43:13.513618+0000","last_active":"2024-09-19T08:43:24.371257+0000","last_peered":"2024-09-19T08:43:24.371257+0000","last_clean":"2024-09-19T08:43:24.371257+0000","last_became_active":"2024-09-19T08:43:13.513281+0000","last_became_peered":"2024-09-19T08:43:13.513281+0000","last_unstale":"2024-09-19T08:43:24.371257+0000","last_undegraded":"2024-09-19T08:43:24.371257+0000","last_fullsized":"2024-09-19T08:43:24.371257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:40.874071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007247+0000","last_change":"2024-09-19T08:43:11.457087+0000","last_active":"2024-09-19T08:43:26.007247+0000","last_peered":"2024-09-19T08:43:26.007247+0000","last_clean":"2024-09-19T08:43:26.007247+0000","last_became_active":"2024-09-19T08:43:11.456687+0000","last_became_peered":"2024-09-19T08:43:11.456687+0000","last_unstale":"2024-09-19T08:43:26.007247+0000","last_undegraded":"2024-09-19T08:43:26.007247+0000","last_fullsized":"2024-09-19T08:43:26.007247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:40.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547719+0000","last_change":"2024-09-19T08:43:20.540740+0000","last_active":"2024-09-19T08:43:23.547719+0000","last_peered":"2024-09-19T08:43:23.547719+0000","last_clean":"2024-09-19T08:43:23.547719+0000","last_became_active":"2024-09-19T08:43:20.540044+0000","last_became_peered":"2024-09-19T08:43:20.540044+0000","last_unstale":"2024-09-19T08:43:23.547719+0000","last_undegraded":"2024-09-19T08:43:23.547719+0000","last_fullsized":"2024-09-19T08:43:23.547719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:11.238259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548037+0000","last_change":"2024-09-19T08:43:13.514193+0000","last_active":"2024-09-19T08:43:23.548037+0000","last_peered":"2024-09-19T08:43:23.548037+0000","last_clean":"2024-09-19T08:43:23.548037+0000","last_became_active":"2024-09-19T08:43:13.513864+0000","last_became_peered":"2024-09-19T08:43:13.513864+0000","last_unstale":"2024-09-19T08:43:23.548037+0000","last_undegraded":"2024-09-19T08:43:23.548037+0000","last_fullsized":"2024-09-19T08:43:23.548037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:15.575162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006669+0000","last_change":"2024-09-19T08:43:12.059836+0000","last_active":"2024-09-19T08:43:26.006669+0000","last_peered":"2024-09-19T08:43:26.006669+0000","last_clean":"2024-09-19T08:43:26.006669+0000","last_became_active":"2024-09-19T08:43:12.059459+0000","last_became_peered":"2024-09-19T08:43:12.059459+0000","last_unstale":"2024-09-19T08:43:26.006669+0000","last_undegraded":"2024-09-19T08:43:26.006669+0000","last_fullsized":"2024-09-19T08:43:26.006669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:53.932649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007491+0000","last_change":"2024-09-19T08:43:20.540919+0000","last_active":"2024-09-19T08:43:26.007491+0000","last_peered":"2024-09-19T08:43:26.007491+0000","last_clean":"2024-09-19T08:43:26.007491+0000","last_became_active":"2024-09-19T08:43:20.540535+0000","last_became_peered":"2024-09-19T08:43:20.540535+0000","last_unstale":"2024-09-19T08:43:26.007491+0000","last_undegraded":"2024-09-19T08:43:26.007491+0000","last_fullsized":"2024-09-19T08:43:26.007491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:32.767025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934701+0000","last_change":"2024-09-19T08:43:13.511693+0000","last_active":"2024-09-19T08:43:24.934701+0000","last_peered":"2024-09-19T08:43:24.934701+0000","last_clean":"2024-09-19T08:43:24.934701+0000","last_became_active":"2024-09-19T08:43:13.511347+0000","last_became_peered":"2024-09-19T08:43:13.511347+0000","last_unstale":"2024-09-19T08:43:24.934701+0000","last_undegraded":"2024-09-19T08:43:24.934701+0000","last_fullsized":"2024-09-19T08:43:24.934701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:22.146900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597617+0000","last_change":"2024-09-19T08:43:11.461514+0000","last_active":"2024-09-19T08:43:24.597617+0000","last_peered":"2024-09-19T08:43:24.597617+0000","last_clean":"2024-09-19T08:43:24.597617+0000","last_became_active":"2024-09-19T08:43:11.461079+0000","last_became_peered":"2024-09-19T08:43:11.461079+0000","last_unstale":"2024-09-19T08:43:24.597617+0000","last_undegraded":"2024-09-19T08:43:24.597617+0000","last_fullsized":"2024-09-19T08:43:24.597617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:10.978243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072134+0000","last_change":"2024-09-19T08:43:20.546834+0000","last_active":"2024-09-19T08:43:25.072134+0000","last_peered":"2024-09-19T08:43:25.072134+0000","last_clean":"2024-09-19T08:43:25.072134+0000","last_became_active":"2024-09-19T08:43:20.545732+0000","last_became_peered":"2024-09-19T08:43:20.545732+0000","last_unstale":"2024-09-19T08:43:25.072134+0000","last_undegraded":"2024-09-19T08:43:25.072134+0000","last_fullsized":"2024-09-19T08:43:25.072134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:56.570928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934979+0000","last_change":"2024-09-19T08:43:13.508295+0000","last_active":"2024-09-19T08:43:24.934979+0000","last_peered":"2024-09-19T08:43:24.934979+0000","last_clean":"2024-09-19T08:43:24.934979+0000","last_became_active":"2024-09-19T08:43:13.507988+0000","last_became_peered":"2024-09-19T08:43:13.507988+0000","last_unstale":"2024-09-19T08:43:24.934979+0000","last_undegraded":"2024-09-19T08:43:24.934979+0000","last_fullsized":"2024-09-19T08:43:24.934979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:33.473262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547918+0000","last_change":"2024-09-19T08:43:11.457965+0000","last_active":"2024-09-19T08:43:23.547918+0000","last_peered":"2024-09-19T08:43:23.547918+0000","last_clean":"2024-09-19T08:43:23.547918+0000","last_became_active":"2024-09-19T08:43:11.456616+0000","last_became_peered":"2024-09-19T08:43:11.456616+0000","last_unstale":"2024-09-19T08:43:23.547918+0000","last_undegraded":"2024-09-19T08:43:23.547918+0000","last_fullsized":"2024-09-19T08:43:23.547918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:17.635896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371082+0000","last_change":"2024-09-19T08:43:20.546848+0000","last_active":"2024-09-19T08:43:24.371082+0000","last_peered":"2024-09-19T08:43:24.371082+0000","last_clean":"2024-09-19T08:43:24.371082+0000","last_became_active":"2024-09-19T08:43:20.546430+0000","last_became_peered":"2024-09-19T08:43:20.546430+0000","last_unstale":"2024-09-19T08:43:24.371082+0000","last_undegraded":"2024-09-19T08:43:24.371082+0000","last_fullsized":"2024-09-19T08:43:24.371082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:39.031339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007156+0000","last_change":"2024-09-19T08:43:13.499817+0000","last_active":"2024-09-19T08:43:26.007156+0000","last_peered":"2024-09-19T08:43:26.007156+0000","last_clean":"2024-09-19T08:43:26.007156+0000","last_became_active":"2024-09-19T08:43:13.499446+0000","last_became_peered":"2024-09-19T08:43:13.499446+0000","last_unstale":"2024-09-19T08:43:26.007156+0000","last_undegraded":"2024-09-19T08:43:26.007156+0000","last_fullsized":"2024-09-19T08:43:26.007156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:04.093262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930712+0000","last_change":"2024-09-19T08:43:11.464099+0000","last_active":"2024-09-19T08:43:24.930712+0000","last_peered":"2024-09-19T08:43:24.930712+0000","last_clean":"2024-09-19T08:43:24.930712+0000","last_became_active":"2024-09-19T08:43:11.463735+0000","last_became_peered":"2024-09-19T08:43:11.463735+0000","last_unstale":"2024-09-19T08:43:24.930712+0000","last_undegraded":"2024-09-19T08:43:24.930712+0000","last_fullsized":"2024-09-19T08:43:24.930712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:10.951239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548236+0000","last_change":"2024-09-19T08:43:20.537810+0000","last_active":"2024-09-19T08:43:23.548236+0000","last_peered":"2024-09-19T08:43:23.548236+0000","last_clean":"2024-09-19T08:43:23.548236+0000","last_became_active":"2024-09-19T08:43:20.537355+0000","last_became_peered":"2024-09-19T08:43:20.537355+0000","last_unstale":"2024-09-19T08:43:23.548236+0000","last_undegraded":"2024-09-19T08:43:23.548236+0000","last_fullsized":"2024-09-19T08:43:23.548236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:55.767023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007046+0000","last_change":"2024-09-19T08:43:13.502536+0000","last_active":"2024-09-19T08:43:26.007046+0000","last_peered":"2024-09-19T08:43:26.007046+0000","last_clean":"2024-09-19T08:43:26.007046+0000","last_became_active":"2024-09-19T08:43:13.500808+0000","last_became_peered":"2024-09-19T08:43:13.500808+0000","last_unstale":"2024-09-19T08:43:26.007046+0000","last_undegraded":"2024-09-19T08:43:26.007046+0000","last_fullsized":"2024-09-19T08:43:26.007046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:51.902896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:44:10.670616+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:44:10.670616+0000","last_peered":"2024-09-19T08:44:10.670616+0000","last_clean":"2024-09-19T08:44:10.670616+0000","last_became_active":"2024-09-19T08:43:11.463756+0000","last_became_peered":"2024-09-19T08:43:11.463756+0000","last_unstale":"2024-09-19T08:44:10.670616+0000","last_undegraded":"2024-09-19T08:44:10.670616+0000","last_fullsized":"2024-09-19T08:44:10.670616+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:39.124949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59246,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":78,"num_write":28,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.071733+0000","last_change":"2024-09-19T08:43:20.546900+0000","last_active":"2024-09-19T08:43:25.071733+0000","last_peered":"2024-09-19T08:43:25.071733+0000","last_clean":"2024-09-19T08:43:25.071733+0000","last_became_active":"2024-09-19T08:43:20.545914+0000","last_became_peered":"2024-09-19T08:43:20.545914+0000","last_unstale":"2024-09-19T08:43:25.071733+0000","last_undegraded":"2024-09-19T08:43:25.071733+0000","last_fullsized":"2024-09-19T08:43:25.071733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:02.842999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547819+0000","last_change":"2024-09-19T08:43:13.510848+0000","last_active":"2024-09-19T08:43:23.547819+0000","last_peered":"2024-09-19T08:43:23.547819+0000","last_clean":"2024-09-19T08:43:23.547819+0000","last_became_active":"2024-09-19T08:43:13.510224+0000","last_became_peered":"2024-09-19T08:43:13.510224+0000","last_unstale":"2024-09-19T08:43:23.547819+0000","last_undegraded":"2024-09-19T08:43:23.547819+0000","last_fullsized":"2024-09-19T08:43:23.547819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:56.113933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548324+0000","last_change":"2024-09-19T08:43:12.061493+0000","last_active":"2024-09-19T08:43:23.548324+0000","last_peered":"2024-09-19T08:43:23.548324+0000","last_clean":"2024-09-19T08:43:23.548324+0000","last_became_active":"2024-09-19T08:43:12.061157+0000","last_became_peered":"2024-09-19T08:43:12.061157+0000","last_unstale":"2024-09-19T08:43:23.548324+0000","last_undegraded":"2024-09-19T08:43:23.548324+0000","last_fullsized":"2024-09-19T08:43:23.548324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:59.542997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597585+0000","last_change":"2024-09-19T08:43:20.546703+0000","last_active":"2024-09-19T08:43:24.597585+0000","last_peered":"2024-09-19T08:43:24.597585+0000","last_clean":"2024-09-19T08:43:24.597585+0000","last_became_active":"2024-09-19T08:43:20.546247+0000","last_became_peered":"2024-09-19T08:43:20.546247+0000","last_unstale":"2024-09-19T08:43:24.597585+0000","last_undegraded":"2024-09-19T08:43:24.597585+0000","last_fullsized":"2024-09-19T08:43:24.597585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:53.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006823+0000","last_change":"2024-09-19T08:43:13.508524+0000","last_active":"2024-09-19T08:43:26.006823+0000","last_peered":"2024-09-19T08:43:26.006823+0000","last_clean":"2024-09-19T08:43:26.006823+0000","last_became_active":"2024-09-19T08:43:13.508213+0000","last_became_peered":"2024-09-19T08:43:13.508213+0000","last_unstale":"2024-09-19T08:43:26.006823+0000","last_undegraded":"2024-09-19T08:43:26.006823+0000","last_fullsized":"2024-09-19T08:43:26.006823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:13.211949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935331+0000","last_change":"2024-09-19T08:43:11.460928+0000","last_active":"2024-09-19T08:43:24.935331+0000","last_peered":"2024-09-19T08:43:24.935331+0000","last_clean":"2024-09-19T08:43:24.935331+0000","last_became_active":"2024-09-19T08:43:11.460555+0000","last_became_peered":"2024-09-19T08:43:11.460555+0000","last_unstale":"2024-09-19T08:43:24.935331+0000","last_undegraded":"2024-09-19T08:43:24.935331+0000","last_fullsized":"2024-09-19T08:43:24.935331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:21.671235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.071524+0000","last_change":"2024-09-19T08:43:20.547775+0000","last_active":"2024-09-19T08:43:25.071524+0000","last_peered":"2024-09-19T08:43:25.071524+0000","last_clean":"2024-09-19T08:43:25.071524+0000","last_became_active":"2024-09-19T08:43:20.547318+0000","last_became_peered":"2024-09-19T08:43:20.547318+0000","last_unstale":"2024-09-19T08:43:25.071524+0000","last_undegraded":"2024-09-19T08:43:25.071524+0000","last_fullsized":"2024-09-19T08:43:25.071524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:14.925314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548148+0000","last_change":"2024-09-19T08:43:13.511510+0000","last_active":"2024-09-19T08:43:23.548148+0000","last_peered":"2024-09-19T08:43:23.548148+0000","last_clean":"2024-09-19T08:43:23.548148+0000","last_became_active":"2024-09-19T08:43:13.511184+0000","last_became_peered":"2024-09-19T08:43:13.511184+0000","last_unstale":"2024-09-19T08:43:23.548148+0000","last_undegraded":"2024-09-19T08:43:23.548148+0000","last_fullsized":"2024-09-19T08:43:23.548148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:23.864506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007510+0000","last_change":"2024-09-19T08:43:11.460981+0000","last_active":"2024-09-19T08:43:26.007510+0000","last_peered":"2024-09-19T08:43:26.007510+0000","last_clean":"2024-09-19T08:43:26.007510+0000","last_became_active":"2024-09-19T08:43:11.460484+0000","last_became_peered":"2024-09-19T08:43:11.460484+0000","last_unstale":"2024-09-19T08:43:26.007510+0000","last_undegraded":"2024-09-19T08:43:26.007510+0000","last_fullsized":"2024-09-19T08:43:26.007510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:35.952469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547236+0000","last_change":"2024-09-19T08:43:20.544626+0000","last_active":"2024-09-19T08:43:23.547236+0000","last_peered":"2024-09-19T08:43:23.547236+0000","last_clean":"2024-09-19T08:43:23.547236+0000","last_became_active":"2024-09-19T08:43:20.543836+0000","last_became_peered":"2024-09-19T08:43:20.543836+0000","last_unstale":"2024-09-19T08:43:23.547236+0000","last_undegraded":"2024-09-19T08:43:23.547236+0000","last_fullsized":"2024-09-19T08:43:23.547236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:17.508084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006485+0000","last_change":"2024-09-19T08:43:20.539467+0000","last_active":"2024-09-19T08:43:26.006485+0000","last_peered":"2024-09-19T08:43:26.006485+0000","last_clean":"2024-09-19T08:43:26.006485+0000","last_became_active":"2024-09-19T08:43:20.539077+0000","last_became_peered":"2024-09-19T08:43:20.539077+0000","last_unstale":"2024-09-19T08:43:26.006485+0000","last_undegraded":"2024-09-19T08:43:26.006485+0000","last_fullsized":"2024-09-19T08:43:26.006485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:10.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.071662+0000","last_change":"2024-09-19T08:43:13.505261+0000","last_active":"2024-09-19T08:43:25.071662+0000","last_peered":"2024-09-19T08:43:25.071662+0000","last_clean":"2024-09-19T08:43:25.071662+0000","last_became_active":"2024-09-19T08:43:13.504984+0000","last_became_peered":"2024-09-19T08:43:13.504984+0000","last_unstale":"2024-09-19T08:43:25.071662+0000","last_undegraded":"2024-09-19T08:43:25.071662+0000","last_fullsized":"2024-09-19T08:43:25.071662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:34.074003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547963+0000","last_change":"2024-09-19T08:43:11.457207+0000","last_active":"2024-09-19T08:43:23.547963+0000","last_peered":"2024-09-19T08:43:23.547963+0000","last_clean":"2024-09-19T08:43:23.547963+0000","last_became_active":"2024-09-19T08:43:11.456827+0000","last_became_peered":"2024-09-19T08:43:11.456827+0000","last_unstale":"2024-09-19T08:43:23.547963+0000","last_undegraded":"2024-09-19T08:43:23.547963+0000","last_fullsized":"2024-09-19T08:43:23.547963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:51.552985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371334+0000","last_change":"2024-09-19T08:43:20.547563+0000","last_active":"2024-09-19T08:43:24.371334+0000","last_peered":"2024-09-19T08:43:24.371334+0000","last_clean":"2024-09-19T08:43:24.371334+0000","last_became_active":"2024-09-19T08:43:20.546909+0000","last_became_peered":"2024-09-19T08:43:20.546909+0000","last_unstale":"2024-09-19T08:43:24.371334+0000","last_undegraded":"2024-09-19T08:43:24.371334+0000","last_fullsized":"2024-09-19T08:43:24.371334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:22.616336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547174+0000","last_change":"2024-09-19T08:43:13.498744+0000","last_active":"2024-09-19T08:43:23.547174+0000","last_peered":"2024-09-19T08:43:23.547174+0000","last_clean":"2024-09-19T08:43:23.547174+0000","last_became_active":"2024-09-19T08:43:13.498459+0000","last_became_peered":"2024-09-19T08:43:13.498459+0000","last_unstale":"2024-09-19T08:43:23.547174+0000","last_undegraded":"2024-09-19T08:43:23.547174+0000","last_fullsized":"2024-09-19T08:43:23.547174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:55.743244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006926+0000","last_change":"2024-09-19T08:43:11.455855+0000","last_active":"2024-09-19T08:43:26.006926+0000","last_peered":"2024-09-19T08:43:26.006926+0000","last_clean":"2024-09-19T08:43:26.006926+0000","last_became_active":"2024-09-19T08:43:11.455450+0000","last_became_peered":"2024-09-19T08:43:11.455450+0000","last_unstale":"2024-09-19T08:43:26.006926+0000","last_undegraded":"2024-09-19T08:43:26.006926+0000","last_fullsized":"2024-09-19T08:43:26.006926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:45.223953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007169+0000","last_change":"2024-09-19T08:43:11.462187+0000","last_active":"2024-09-19T08:43:26.007169+0000","last_peered":"2024-09-19T08:43:26.007169+0000","last_clean":"2024-09-19T08:43:26.007169+0000","last_became_active":"2024-09-19T08:43:11.461820+0000","last_became_peered":"2024-09-19T08:43:11.461820+0000","last_unstale":"2024-09-19T08:43:26.007169+0000","last_undegraded":"2024-09-19T08:43:26.007169+0000","last_fullsized":"2024-09-19T08:43:26.007169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.910058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547896+0000","last_change":"2024-09-19T08:43:13.516825+0000","last_active":"2024-09-19T08:43:23.547896+0000","last_peered":"2024-09-19T08:43:23.547896+0000","last_clean":"2024-09-19T08:43:23.547896+0000","last_became_active":"2024-09-19T08:43:13.516426+0000","last_became_peered":"2024-09-19T08:43:13.516426+0000","last_unstale":"2024-09-19T08:43:23.547896+0000","last_undegraded":"2024-09-19T08:43:23.547896+0000","last_fullsized":"2024-09-19T08:43:23.547896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:31.779517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930730+0000","last_change":"2024-09-19T08:43:20.550696+0000","last_active":"2024-09-19T08:43:24.930730+0000","last_peered":"2024-09-19T08:43:24.930730+0000","last_clean":"2024-09-19T08:43:24.930730+0000","last_became_active":"2024-09-19T08:43:20.550289+0000","last_became_peered":"2024-09-19T08:43:20.550289+0000","last_unstale":"2024-09-19T08:43:24.930730+0000","last_undegraded":"2024-09-19T08:43:24.930730+0000","last_fullsized":"2024-09-19T08:43:24.930730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:57.549540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547908+0000","last_change":"2024-09-19T08:43:11.460452+0000","last_active":"2024-09-19T08:43:23.547908+0000","last_peered":"2024-09-19T08:43:23.547908+0000","last_clean":"2024-09-19T08:43:23.547908+0000","last_became_active":"2024-09-19T08:43:11.460113+0000","last_became_peered":"2024-09-19T08:43:11.460113+0000","last_unstale":"2024-09-19T08:43:23.547908+0000","last_undegraded":"2024-09-19T08:43:23.547908+0000","last_fullsized":"2024-09-19T08:43:23.547908+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:02.112243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006819+0000","last_change":"2024-09-19T08:43:13.506092+0000","last_active":"2024-09-19T08:43:26.006819+0000","last_peered":"2024-09-19T08:43:26.006819+0000","last_clean":"2024-09-19T08:43:26.006819+0000","last_became_active":"2024-09-19T08:43:13.505715+0000","last_became_peered":"2024-09-19T08:43:13.505715+0000","last_unstale":"2024-09-19T08:43:26.006819+0000","last_undegraded":"2024-09-19T08:43:26.006819+0000","last_fullsized":"2024-09-19T08:43:26.006819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:30.256482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930657+0000","last_change":"2024-09-19T08:43:20.540759+0000","last_active":"2024-09-19T08:43:24.930657+0000","last_peered":"2024-09-19T08:43:24.930657+0000","last_clean":"2024-09-19T08:43:24.930657+0000","last_became_active":"2024-09-19T08:43:20.540275+0000","last_became_peered":"2024-09-19T08:43:20.540275+0000","last_unstale":"2024-09-19T08:43:24.930657+0000","last_undegraded":"2024-09-19T08:43:24.930657+0000","last_fullsized":"2024-09-19T08:43:24.930657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:20.032982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.370850+0000","last_change":"2024-09-19T08:43:13.513571+0000","last_active":"2024-09-19T08:43:24.370850+0000","last_peered":"2024-09-19T08:43:24.370850+0000","last_clean":"2024-09-19T08:43:24.370850+0000","last_became_active":"2024-09-19T08:43:13.513239+0000","last_became_peered":"2024-09-19T08:43:13.513239+0000","last_unstale":"2024-09-19T08:43:24.370850+0000","last_undegraded":"2024-09-19T08:43:24.370850+0000","last_fullsized":"2024-09-19T08:43:24.370850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:13.678752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930774+0000","last_change":"2024-09-19T08:43:13.507735+0000","last_active":"2024-09-19T08:43:24.930774+0000","last_peered":"2024-09-19T08:43:24.930774+0000","last_clean":"2024-09-19T08:43:24.930774+0000","last_became_active":"2024-09-19T08:43:13.507279+0000","last_became_peered":"2024-09-19T08:43:13.507279+0000","last_unstale":"2024-09-19T08:43:24.930774+0000","last_undegraded":"2024-09-19T08:43:24.930774+0000","last_fullsized":"2024-09-19T08:43:24.930774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:48.920412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930437+0000","last_change":"2024-09-19T08:43:13.504453+0000","last_active":"2024-09-19T08:43:24.930437+0000","last_peered":"2024-09-19T08:43:24.930437+0000","last_clean":"2024-09-19T08:43:24.930437+0000","last_became_active":"2024-09-19T08:43:13.503985+0000","last_became_peered":"2024-09-19T08:43:13.503985+0000","last_unstale":"2024-09-19T08:43:24.930437+0000","last_undegraded":"2024-09-19T08:43:24.930437+0000","last_fullsized":"2024-09-19T08:43:24.930437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:38.641817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006452+0000","last_change":"2024-09-19T08:43:13.509833+0000","last_active":"2024-09-19T08:43:26.006452+0000","last_peered":"2024-09-19T08:43:26.006452+0000","last_clean":"2024-09-19T08:43:26.006452+0000","last_became_active":"2024-09-19T08:43:13.509523+0000","last_became_peered":"2024-09-19T08:43:13.509523+0000","last_unstale":"2024-09-19T08:43:26.006452+0000","last_undegraded":"2024-09-19T08:43:26.006452+0000","last_fullsized":"2024-09-19T08:43:26.006452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:59.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007403+0000","last_change":"2024-09-19T08:43:13.502624+0000","last_active":"2024-09-19T08:43:26.007403+0000","last_peered":"2024-09-19T08:43:26.007403+0000","last_clean":"2024-09-19T08:43:26.007403+0000","last_became_active":"2024-09-19T08:43:13.502321+0000","last_became_peered":"2024-09-19T08:43:13.502321+0000","last_unstale":"2024-09-19T08:43:26.007403+0000","last_undegraded":"2024-09-19T08:43:26.007403+0000","last_fullsized":"2024-09-19T08:43:26.007403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:41.724026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371275+0000","last_change":"2024-09-19T08:43:13.515261+0000","last_active":"2024-09-19T08:43:24.371275+0000","last_peered":"2024-09-19T08:43:24.371275+0000","last_clean":"2024-09-19T08:43:24.371275+0000","last_became_active":"2024-09-19T08:43:13.514741+0000","last_became_peered":"2024-09-19T08:43:13.514741+0000","last_unstale":"2024-09-19T08:43:24.371275+0000","last_undegraded":"2024-09-19T08:43:24.371275+0000","last_fullsized":"2024-09-19T08:43:24.371275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:16.348859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930963+0000","last_change":"2024-09-19T08:43:13.512820+0000","last_active":"2024-09-19T08:43:24.930963+0000","last_peered":"2024-09-19T08:43:24.930963+0000","last_clean":"2024-09-19T08:43:24.930963+0000","last_became_active":"2024-09-19T08:43:13.512503+0000","last_became_peered":"2024-09-19T08:43:13.512503+0000","last_unstale":"2024-09-19T08:43:24.930963+0000","last_undegraded":"2024-09-19T08:43:24.930963+0000","last_fullsized":"2024-09-19T08:43:24.930963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:41.763855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548002+0000","last_change":"2024-09-19T08:43:13.501837+0000","last_active":"2024-09-19T08:43:23.548002+0000","last_peered":"2024-09-19T08:43:23.548002+0000","last_clean":"2024-09-19T08:43:23.548002+0000","last_became_active":"2024-09-19T08:43:13.501561+0000","last_became_peered":"2024-09-19T08:43:13.501561+0000","last_unstale":"2024-09-19T08:43:23.548002+0000","last_undegraded":"2024-09-19T08:43:23.548002+0000","last_fullsized":"2024-09-19T08:43:23.548002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:30.891617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547641+0000","last_change":"2024-09-19T08:43:13.506755+0000","last_active":"2024-09-19T08:43:23.547641+0000","last_peered":"2024-09-19T08:43:23.547641+0000","last_clean":"2024-09-19T08:43:23.547641+0000","last_became_active":"2024-09-19T08:43:13.506462+0000","last_became_peered":"2024-09-19T08:43:13.506462+0000","last_unstale":"2024-09-19T08:43:23.547641+0000","last_undegraded":"2024-09-19T08:43:23.547641+0000","last_fullsized":"2024-09-19T08:43:23.547641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:37.686741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547205+0000","last_change":"2024-09-19T08:43:13.506407+0000","last_active":"2024-09-19T08:43:23.547205+0000","last_peered":"2024-09-19T08:43:23.547205+0000","last_clean":"2024-09-19T08:43:23.547205+0000","last_became_active":"2024-09-19T08:43:13.506094+0000","last_became_peered":"2024-09-19T08:43:13.506094+0000","last_unstale":"2024-09-19T08:43:23.547205+0000","last_undegraded":"2024-09-19T08:43:23.547205+0000","last_fullsized":"2024-09-19T08:43:23.547205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:40.654865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547777+0000","last_change":"2024-09-19T08:43:13.502542+0000","last_active":"2024-09-19T08:43:23.547777+0000","last_peered":"2024-09-19T08:43:23.547777+0000","last_clean":"2024-09-19T08:43:23.547777+0000","last_became_active":"2024-09-19T08:43:13.502186+0000","last_became_peered":"2024-09-19T08:43:13.502186+0000","last_unstale":"2024-09-19T08:43:23.547777+0000","last_undegraded":"2024-09-19T08:43:23.547777+0000","last_fullsized":"2024-09-19T08:43:23.547777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:18.022089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007151+0000","last_change":"2024-09-19T08:43:13.500097+0000","last_active":"2024-09-19T08:43:26.007151+0000","last_peered":"2024-09-19T08:43:26.007151+0000","last_clean":"2024-09-19T08:43:26.007151+0000","last_became_active":"2024-09-19T08:43:13.499403+0000","last_became_peered":"2024-09-19T08:43:13.499403+0000","last_unstale":"2024-09-19T08:43:26.007151+0000","last_undegraded":"2024-09-19T08:43:26.007151+0000","last_fullsized":"2024-09-19T08:43:26.007151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:29.772783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371034+0000","last_change":"2024-09-19T08:43:13.509855+0000","last_active":"2024-09-19T08:43:24.371034+0000","last_peered":"2024-09-19T08:43:24.371034+0000","last_clean":"2024-09-19T08:43:24.371034+0000","last_became_active":"2024-09-19T08:43:13.509531+0000","last_became_peered":"2024-09-19T08:43:13.509531+0000","last_unstale":"2024-09-19T08:43:24.371034+0000","last_undegraded":"2024-09-19T08:43:24.371034+0000","last_fullsized":"2024-09-19T08:43:24.371034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:47.722940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.930845+0000","last_change":"2024-09-19T08:43:13.507443+0000","last_active":"2024-09-19T08:43:24.930845+0000","last_peered":"2024-09-19T08:43:24.930845+0000","last_clean":"2024-09-19T08:43:24.930845+0000","last_became_active":"2024-09-19T08:43:13.505626+0000","last_became_peered":"2024-09-19T08:43:13.505626+0000","last_unstale":"2024-09-19T08:43:24.930845+0000","last_undegraded":"2024-09-19T08:43:24.930845+0000","last_fullsized":"2024-09-19T08:43:24.930845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:27.130768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:25.072064+0000","last_change":"2024-09-19T08:43:13.513796+0000","last_active":"2024-09-19T08:43:25.072064+0000","last_peered":"2024-09-19T08:43:25.072064+0000","last_clean":"2024-09-19T08:43:25.072064+0000","last_became_active":"2024-09-19T08:43:13.513519+0000","last_became_peered":"2024-09-19T08:43:13.513519+0000","last_unstale":"2024-09-19T08:43:25.072064+0000","last_undegraded":"2024-09-19T08:43:25.072064+0000","last_fullsized":"2024-09-19T08:43:25.072064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:32.118184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371448+0000","last_change":"2024-09-19T08:43:13.515267+0000","last_active":"2024-09-19T08:43:24.371448+0000","last_peered":"2024-09-19T08:43:24.371448+0000","last_clean":"2024-09-19T08:43:24.371448+0000","last_became_active":"2024-09-19T08:43:13.514806+0000","last_became_peered":"2024-09-19T08:43:13.514806+0000","last_unstale":"2024-09-19T08:43:24.371448+0000","last_undegraded":"2024-09-19T08:43:24.371448+0000","last_fullsized":"2024-09-19T08:43:24.371448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:10.977591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547401+0000","last_change":"2024-09-19T08:43:13.508047+0000","last_active":"2024-09-19T08:43:23.547401+0000","last_peered":"2024-09-19T08:43:23.547401+0000","last_clean":"2024-09-19T08:43:23.547401+0000","last_became_active":"2024-09-19T08:43:13.505069+0000","last_became_peered":"2024-09-19T08:43:13.505069+0000","last_unstale":"2024-09-19T08:43:23.547401+0000","last_undegraded":"2024-09-19T08:43:23.547401+0000","last_fullsized":"2024-09-19T08:43:23.547401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.321943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006221+0000","last_change":"2024-09-19T08:43:13.510178+0000","last_active":"2024-09-19T08:43:26.006221+0000","last_peered":"2024-09-19T08:43:26.006221+0000","last_clean":"2024-09-19T08:43:26.006221+0000","last_became_active":"2024-09-19T08:43:13.509620+0000","last_became_peered":"2024-09-19T08:43:13.509620+0000","last_unstale":"2024-09-19T08:43:26.006221+0000","last_undegraded":"2024-09-19T08:43:26.006221+0000","last_fullsized":"2024-09-19T08:43:26.006221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:01.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006155+0000","last_change":"2024-09-19T08:43:13.505288+0000","last_active":"2024-09-19T08:43:26.006155+0000","last_peered":"2024-09-19T08:43:26.006155+0000","last_clean":"2024-09-19T08:43:26.006155+0000","last_became_active":"2024-09-19T08:43:13.504813+0000","last_became_peered":"2024-09-19T08:43:13.504813+0000","last_unstale":"2024-09-19T08:43:26.006155+0000","last_undegraded":"2024-09-19T08:43:26.006155+0000","last_fullsized":"2024-09-19T08:43:26.006155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:17.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007145+0000","last_change":"2024-09-19T08:43:13.508392+0000","last_active":"2024-09-19T08:43:26.007145+0000","last_peered":"2024-09-19T08:43:26.007145+0000","last_clean":"2024-09-19T08:43:26.007145+0000","last_became_active":"2024-09-19T08:43:13.507924+0000","last_became_peered":"2024-09-19T08:43:13.507924+0000","last_unstale":"2024-09-19T08:43:26.007145+0000","last_undegraded":"2024-09-19T08:43:26.007145+0000","last_fullsized":"2024-09-19T08:43:26.007145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:41.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.598019+0000","last_change":"2024-09-19T08:43:13.513906+0000","last_active":"2024-09-19T08:43:24.598019+0000","last_peered":"2024-09-19T08:43:24.598019+0000","last_clean":"2024-09-19T08:43:24.598019+0000","last_became_active":"2024-09-19T08:43:13.513570+0000","last_became_peered":"2024-09-19T08:43:13.513570+0000","last_unstale":"2024-09-19T08:43:24.598019+0000","last_undegraded":"2024-09-19T08:43:24.598019+0000","last_fullsized":"2024-09-19T08:43:24.598019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:13.516639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.935292+0000","last_change":"2024-09-19T08:43:13.513776+0000","last_active":"2024-09-19T08:43:24.935292+0000","last_peered":"2024-09-19T08:43:24.935292+0000","last_clean":"2024-09-19T08:43:24.935292+0000","last_became_active":"2024-09-19T08:43:13.513087+0000","last_became_peered":"2024-09-19T08:43:13.513087+0000","last_unstale":"2024-09-19T08:43:24.935292+0000","last_undegraded":"2024-09-19T08:43:24.935292+0000","last_fullsized":"2024-09-19T08:43:24.935292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:09.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007612+0000","last_change":"2024-09-19T08:43:13.509904+0000","last_active":"2024-09-19T08:43:26.007612+0000","last_peered":"2024-09-19T08:43:26.007612+0000","last_clean":"2024-09-19T08:43:26.007612+0000","last_became_active":"2024-09-19T08:43:13.509550+0000","last_became_peered":"2024-09-19T08:43:13.509550+0000","last_unstale":"2024-09-19T08:43:26.007612+0000","last_undegraded":"2024-09-19T08:43:26.007612+0000","last_fullsized":"2024-09-19T08:43:26.007612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:05.505592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.548081+0000","last_change":"2024-09-19T08:43:13.513825+0000","last_active":"2024-09-19T08:43:23.548081+0000","last_peered":"2024-09-19T08:43:23.548081+0000","last_clean":"2024-09-19T08:43:23.548081+0000","last_became_active":"2024-09-19T08:43:13.513458+0000","last_became_peered":"2024-09-19T08:43:13.513458+0000","last_unstale":"2024-09-19T08:43:23.548081+0000","last_undegraded":"2024-09-19T08:43:23.548081+0000","last_fullsized":"2024-09-19T08:43:23.548081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:22.141180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:23.547082+0000","last_change":"2024-09-19T08:43:13.512512+0000","last_active":"2024-09-19T08:43:23.547082+0000","last_peered":"2024-09-19T08:43:23.547082+0000","last_clean":"2024-09-19T08:43:23.547082+0000","last_became_active":"2024-09-19T08:43:13.512117+0000","last_became_peered":"2024-09-19T08:43:13.512117+0000","last_unstale":"2024-09-19T08:43:23.547082+0000","last_undegraded":"2024-09-19T08:43:23.547082+0000","last_fullsized":"2024-09-19T08:43:23.547082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:05.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.934853+0000","last_change":"2024-09-19T08:43:13.510732+0000","last_active":"2024-09-19T08:43:24.934853+0000","last_peered":"2024-09-19T08:43:24.934853+0000","last_clean":"2024-09-19T08:43:24.934853+0000","last_became_active":"2024-09-19T08:43:13.510412+0000","last_became_peered":"2024-09-19T08:43:13.510412+0000","last_unstale":"2024-09-19T08:43:24.934853+0000","last_undegraded":"2024-09-19T08:43:24.934853+0000","last_fullsized":"2024-09-19T08:43:24.934853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:32.057417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.007105+0000","last_change":"2024-09-19T08:43:13.509665+0000","last_active":"2024-09-19T08:43:26.007105+0000","last_peered":"2024-09-19T08:43:26.007105+0000","last_clean":"2024-09-19T08:43:26.007105+0000","last_became_active":"2024-09-19T08:43:13.509331+0000","last_became_peered":"2024-09-19T08:43:13.509331+0000","last_unstale":"2024-09-19T08:43:26.007105+0000","last_undegraded":"2024-09-19T08:43:26.007105+0000","last_fullsized":"2024-09-19T08:43:26.007105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:18.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006752+0000","last_change":"2024-09-19T08:43:13.498969+0000","last_active":"2024-09-19T08:43:26.006752+0000","last_peered":"2024-09-19T08:43:26.006752+0000","last_clean":"2024-09-19T08:43:26.006752+0000","last_became_active":"2024-09-19T08:43:13.498274+0000","last_became_peered":"2024-09-19T08:43:13.498274+0000","last_unstale":"2024-09-19T08:43:26.006752+0000","last_undegraded":"2024-09-19T08:43:26.006752+0000","last_fullsized":"2024-09-19T08:43:26.006752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:53.220934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.597990+0000","last_change":"2024-09-19T08:43:13.515101+0000","last_active":"2024-09-19T08:43:24.597990+0000","last_peered":"2024-09-19T08:43:24.597990+0000","last_clean":"2024-09-19T08:43:24.597990+0000","last_became_active":"2024-09-19T08:43:13.514476+0000","last_became_peered":"2024-09-19T08:43:13.514476+0000","last_unstale":"2024-09-19T08:43:24.597990+0000","last_undegraded":"2024-09-19T08:43:24.597990+0000","last_fullsized":"2024-09-19T08:43:24.597990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:34.864832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006393+0000","last_change":"2024-09-19T08:43:13.513978+0000","last_active":"2024-09-19T08:43:26.006393+0000","last_peered":"2024-09-19T08:43:26.006393+0000","last_clean":"2024-09-19T08:43:26.006393+0000","last_became_active":"2024-09-19T08:43:13.513644+0000","last_became_peered":"2024-09-19T08:43:13.513644+0000","last_unstale":"2024-09-19T08:43:26.006393+0000","last_undegraded":"2024-09-19T08:43:26.006393+0000","last_fullsized":"2024-09-19T08:43:26.006393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.496383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:26.006624+0000","last_change":"2024-09-19T08:43:13.504697+0000","last_active":"2024-09-19T08:43:26.006624+0000","last_peered":"2024-09-19T08:43:26.006624+0000","last_clean":"2024-09-19T08:43:26.006624+0000","last_became_active":"2024-09-19T08:43:13.504329+0000","last_became_peered":"2024-09-19T08:43:13.504329+0000","last_unstale":"2024-09-19T08:43:26.006624+0000","last_undegraded":"2024-09-19T08:43:26.006624+0000","last_fullsized":"2024-09-19T08:43:26.006624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:54.393292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T08:43:24.371446+0000","last_change":"2024-09-19T08:43:13.514793+0000","last_active":"2024-09-19T08:43:24.371446+0000","last_peered":"2024-09-19T08:43:24.371446+0000","last_clean":"2024-09-19T08:43:24.371446+0000","last_became_active":"2024-09-19T08:43:13.514146+0000","last_became_peered":"2024-09-19T08:43:13.514146+0000","last_unstale":"2024-09-19T08:43:24.371446+0000","last_undegraded":"2024-09-19T08:43:24.371446+0000","last_fullsized":"2024-09-19T08:43:24.371446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.616341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60044,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":47,"num_read_kb":84,"num_write":83,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":180132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1122515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":481481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234023,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":477407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708280,"statfs":{"total":95995035648,"available":95957278720,"internally_reserved":0,"allocated":1564672,"data_stored":1071849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593777,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":958464,"data_stored":472707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1067353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":476825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":472811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":521839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":521805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":472797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:13.055 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:44:13.056 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T08:44:13.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:44:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:13.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-09-19T08:44:13.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:13.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:13.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:13.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.579 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-09-19T08:44:13.579 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.579 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:13.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:13.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:13.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-09-19T08:44:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:13.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:44:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/3208867674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 msgr2=0x7fd39c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/3208867674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c101ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd394009900 tx=0x7fd39402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/3208867674 shutdown_connections 2024-09-19T08:44:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/3208867674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd39c1037b0 0x7fd39c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/3208867674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd39c102df0 0x7fd39c103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/3208867674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c101ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/3208867674 >> 172.21.15.18:0/3208867674 conn(0x7fd39c0fd3c0 msgr2=0x7fd39c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/3208867674 shutdown_connections 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.811+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/3208867674 wait complete. 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 Processor -- start 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 -- start start 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd39c102df0 0x7fd39c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd39c1037b0 0x7fd39c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c10d7a0 con 0x7fd39c101bf0 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c10d620 con 0x7fd39c102df0 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd3a0ba8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c10d920 con 0x7fd39c1037b0 2024-09-19T08:44:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51314/0 (socket says 172.21.15.18:51314) 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 -- 172.21.15.18:0/2920399553 learned_addr learned my addr 172.21.15.18:0/2920399553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd399d9b640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd39c102df0 0x7fd39c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39ad9d640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd39c1037b0 0x7fd39c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 -- 172.21.15.18:0/2920399553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd39c1037b0 msgr2=0x7fd39c19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd39c1037b0 0x7fd39c19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 -- 172.21.15.18:0/2920399553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd39c102df0 msgr2=0x7fd39c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.812+0000 7fd39a59c640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd39c102df0 0x7fd39c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd39a59c640 1 -- 172.21.15.18:0/2920399553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c19fa90 con 0x7fd39c101bf0 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd39a59c640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c197e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd3940314e0 tx=0x7fd3940042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39403f030 con 0x7fd39c101bf0 2024-09-19T08:44:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd394003cb0 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394035070 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39c19fd20 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.813+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39c1a0220 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.814+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39c109090 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.815+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd394042030 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.817+0000 7fd3937fe640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd3880a3380 0x7fd3880a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.817+0000 7fd399d9b640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd3880a3380 0x7fd3880a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.817+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fd3940f0250 con 0x7fd39c101bf0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.817+0000 7fd399d9b640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd3880a3380 0x7fd3880a5840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd39c199380 tx=0x7fd38400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:13.821+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd3940bcbd0 con 0x7fd39c101bf0 2024-09-19T08:44:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.064+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fd39c062df0 con 0x7fd39c101bf0 2024-09-19T08:44:14.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.066+0000 7fd3937fe640 1 -- 172.21.15.18:0/2920399553 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fd3940bc4d0 con 0x7fd39c101bf0 2024-09-19T08:44:14.066 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T08:44:14.066 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBe5Otm0QTnAxAAnUrUiSRUlh52NnEsooIZzQ== 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.068+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd3880a3380 msgr2=0x7fd3880a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.068+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd3880a3380 0x7fd3880a5840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd39c199380 tx=0x7fd38400b390 comp rx=0 tx=0).stop 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.068+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 msgr2=0x7fd39c197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.068+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c197e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd3940314e0 tx=0x7fd3940042e0 comp rx=0 tx=0).stop 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 shutdown_connections 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd3880a3380 0x7fd3880a5840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd39c1037b0 0x7fd39c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:14.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd39c102df0 0x7fd39c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:14.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 --2- 172.21.15.18:0/2920399553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd39c101bf0 0x7fd39c197e60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:14.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 >> 172.21.15.18:0/2920399553 conn(0x7fd39c0fd3c0 msgr2=0x7fd39c106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:14.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 shutdown_connections 2024-09-19T08:44:14.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:14.069+0000 7fd3a0ba8640 1 -- 172.21.15.18:0/2920399553 wait complete. 2024-09-19T08:44:14.439 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:14 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2920399553' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:44:14.439 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:14 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2920399553' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:44:14.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:14 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2920399553' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:44:14.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:14 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2920399553' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:44:14.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:14 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2920399553' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:44:14.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:14 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2920399553' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:44:14.788 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:44:14.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T08:44:14.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:44:14.828 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:44:14.828 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:44:14.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T08:44:15.132 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:15.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:15 smithi018 ceph-mon[30956]: pgmap v314: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T08:44:15.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:15 smithi150 ceph-mon[34610]: pgmap v314: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T08:44:15.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 -- 172.21.15.18:0/3441874829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28100a80 msgr2=0x7fde28100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 --2- 172.21.15.18:0/3441874829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28100a80 0x7fde28100ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fde10009930 tx=0x7fde1002a420 comp rx=0 tx=0).stop 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 -- 172.21.15.18:0/3441874829 shutdown_connections 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 --2- 172.21.15.18:0/3441874829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde28101420 0x7fde2810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 --2- 172.21.15.18:0/3441874829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28100a80 0x7fde28100ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 --2- 172.21.15.18:0/3441874829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28106a80 0x7fde28106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 -- 172.21.15.18:0/3441874829 >> 172.21.15.18:0/3441874829 conn(0x7fde280fc7a0 msgr2=0x7fde280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 -- 172.21.15.18:0/3441874829 shutdown_connections 2024-09-19T08:44:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.635+0000 7fde2d02a640 1 -- 172.21.15.18:0/3441874829 wait complete. 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 Processor -- start 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 -- start start 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28100a80 0x7fde28198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde28101420 0x7fde281988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 0x7fde2819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fde28110d30 con 0x7fde28106a80 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fde28110bb0 con 0x7fde28100a80 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2d02a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde28110eb0 con 0x7fde28101420 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 0x7fde2819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 0x7fde2819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51324/0 (socket says 172.21.15.18:51324) 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde26d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28100a80 0x7fde28198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde1e59c640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde28101420 0x7fde281988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.636+0000 7fde2759e640 1 -- 172.21.15.18:0/2801119107 learned_addr learned my addr 172.21.15.18:0/2801119107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde26d9d640 1 -- 172.21.15.18:0/2801119107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde28101420 msgr2=0x7fde281988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde26d9d640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde28101420 0x7fde281988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde26d9d640 1 -- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 msgr2=0x7fde2819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde26d9d640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 0x7fde2819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde26d9d640 1 -- 172.21.15.18:0/2801119107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2819d310 con 0x7fde28100a80 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde2759e640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 0x7fde2819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde26d9d640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28100a80 0x7fde28198360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde1800d6d0 tx=0x7fde1800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18017070 con 0x7fde28100a80 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2819d600 con 0x7fde28100a80 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde18009820 con 0x7fde28100a80 2024-09-19T08:44:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18004c40 con 0x7fde28100a80 2024-09-19T08:44:15.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.637+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde281a4ee0 con 0x7fde28100a80 2024-09-19T08:44:15.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.638+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde28100ee0 con 0x7fde28100a80 2024-09-19T08:44:15.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.640+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fde180099d0 con 0x7fde28100a80 2024-09-19T08:44:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.640+0000 7fde24d99640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fde140a32d0 0x7fde140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.640+0000 7fde1e59c640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fde140a32d0 0x7fde140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.641+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fde180cfb30 con 0x7fde28100a80 2024-09-19T08:44:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.641+0000 7fde1e59c640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fde140a32d0 0x7fde140a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde10009900 tx=0x7fde10000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.644+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde1809be00 con 0x7fde28100a80 2024-09-19T08:44:15.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:15 smithi162 ceph-mon[34870]: pgmap v314: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T08:44:15.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.865+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fde281a50b0 con 0x7fde28100a80 2024-09-19T08:44:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.870+0000 7fde24d99640 1 -- 172.21.15.18:0/2801119107 <== mon.2 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264048 (secure 0 0 0) 0x7fde180a0100 con 0x7fde28100a80 2024-09-19T08:44:15.872 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fde140a32d0 msgr2=0x7fde140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fde140a32d0 0x7fde140a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde10009900 tx=0x7fde10000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28100a80 msgr2=0x7fde28198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28100a80 0x7fde28198360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde1800d6d0 tx=0x7fde1800db90 comp rx=0 tx=0).stop 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 shutdown_connections 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fde140a32d0 0x7fde140a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde28106a80 0x7fde2819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde28101420 0x7fde281988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 --2- 172.21.15.18:0/2801119107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde28100a80 0x7fde28198360 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 >> 172.21.15.18:0/2801119107 conn(0x7fde280fc7a0 msgr2=0x7fde281048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 shutdown_connections 2024-09-19T08:44:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:15.873+0000 7fde2d02a640 1 -- 172.21.15.18:0/2801119107 wait complete. 2024-09-19T08:44:16.529 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2747026181},{"type":"v1","addr":"172.21.15.18:6801","nonce":2747026181}]},"active_addr":"172.21.15.18:6801/2747026181","active_change":"2024-09-19T08:36:17.763126+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.18:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":208953823}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2095521150}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":4019822149}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2260954159}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":212697807}]}]} 2024-09-19T08:44:16.535 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T08:44:16.536 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T08:44:16.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:16.562 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:16 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2801119107' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:44:16.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:16 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2801119107' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:44:16.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:16 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2801119107' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:44:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:17.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 -- 172.21.15.18:0/2932959546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575810c170 msgr2=0x7f575810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:17.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 --2- 172.21.15.18:0/2932959546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575810c170 0x7f575810e610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5750009ca0 tx=0x7f575002a950 comp rx=0 tx=0).stop 2024-09-19T08:44:17.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 -- 172.21.15.18:0/2932959546 shutdown_connections 2024-09-19T08:44:17.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 --2- 172.21.15.18:0/2932959546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575810c170 0x7f575810e610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 --2- 172.21.15.18:0/2932959546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 0x7f575810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 --2- 172.21.15.18:0/2932959546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5758102d40 0x7f5758103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 -- 172.21.15.18:0/2932959546 >> 172.21.15.18:0/2932959546 conn(0x7f57580fc7a0 msgr2=0x7f57580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 -- 172.21.15.18:0/2932959546 shutdown_connections 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.269+0000 7f575ee79640 1 -- 172.21.15.18:0/2932959546 wait complete. 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 Processor -- start 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 -- start start 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 0x7f5758198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 0x7f5758198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f575810c170 0x7f575819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5758111e00 con 0x7f5758102d40 2024-09-19T08:44:17.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5758111c80 con 0x7f575810c170 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575ee79640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5758111f80 con 0x7f5758103660 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 0x7f5758198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 0x7f5758198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51332/0 (socket says 172.21.15.18:51332) 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 -- 172.21.15.18:0/492026599 learned_addr learned my addr 172.21.15.18:0/492026599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f5757fff640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 0x7f5758198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575d416640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f575810c170 0x7f575819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 -- 172.21.15.18:0/492026599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 msgr2=0x7f5758198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 0x7f5758198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 -- 172.21.15.18:0/492026599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f575810c170 msgr2=0x7f575819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f575810c170 0x7f575819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f575cc15640 1 -- 172.21.15.18:0/492026599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575819d2c0 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.270+0000 7f5757fff640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 0x7f5758198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.271+0000 7f575cc15640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 0x7f5758198310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c920 tx=0x7f574c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.271+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c007c70 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.271+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f574c007e10 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.271+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575819d5b0 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.271+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c018820 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.271+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57581a4e90 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.272+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5758103120 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.273+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f574c0189c0 con 0x7f5758102d40 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.274+0000 7f5755ffb640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f57480a3350 0x7f57480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.274+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f574c0cfee0 con 0x7f5758102d40 2024-09-19T08:44:17.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.274+0000 7f5757fff640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f57480a3350 0x7f57480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:17.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.274+0000 7f5757fff640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f57480a3350 0x7f57480a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5744005fd0 tx=0x7f5744005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:17.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.278+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f574c014030 con 0x7f5758102d40 2024-09-19T08:44:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:17 smithi018 ceph-mon[30956]: pgmap v315: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T08:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.455+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57581071e0 con 0x7f5758102d40 2024-09-19T08:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.456+0000 7f5755ffb640 1 -- 172.21.15.18:0/492026599 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24249 (secure 0 0 0) 0x7f574c09c800 con 0x7f5758102d40 2024-09-19T08:44:17.456 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:17.456 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":86,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:43:23.195960+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f57480a3350 msgr2=0x7f57480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f57480a3350 0x7f57480a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5744005fd0 tx=0x7f5744005f00 comp rx=0 tx=0).stop 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 msgr2=0x7f5758198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 0x7f5758198310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c920 tx=0x7f574c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 shutdown_connections 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f57480a3350 0x7f57480a5810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f575810c170 0x7f575819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5758103660 0x7f5758198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 --2- 172.21.15.18:0/492026599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5758102d40 0x7f5758198310 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.458+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 >> 172.21.15.18:0/492026599 conn(0x7f57580fc7a0 msgr2=0x7f57580fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.459+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 shutdown_connections 2024-09-19T08:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:17.459+0000 7f575ee79640 1 -- 172.21.15.18:0/492026599 wait complete. 2024-09-19T08:44:17.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:17 smithi150 ceph-mon[34610]: pgmap v315: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T08:44:17.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:17 smithi162 ceph-mon[34870]: pgmap v315: 129 pgs: 129 active+clean; 635 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T08:44:18.173 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T08:44:18.174 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:18.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/492026599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T08:44:18.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T08:44:18.475 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:18.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/492026599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:18.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T08:44:18.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/492026599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T08:44:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-19T08:44:18.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-19T08:44:18.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T08:44:18.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T08:44:18.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T08:44:18.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 -- 172.21.15.18:0/119423164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 msgr2=0x7f00c81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 --2- 172.21.15.18:0/119423164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81067e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009900 tx=0x7f00b802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 -- 172.21.15.18:0/119423164 shutdown_connections 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 --2- 172.21.15.18:0/119423164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00c8106f10 0x7f00c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 --2- 172.21.15.18:0/119423164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81067e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 --2- 172.21.15.18:0/119423164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00c8101de0 0x7f00c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 -- 172.21.15.18:0/119423164 >> 172.21.15.18:0/119423164 conn(0x7f00c80fd8c0 msgr2=0x7f00c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 -- 172.21.15.18:0/119423164 shutdown_connections 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.938+0000 7f00cf95a640 1 -- 172.21.15.18:0/119423164 wait complete. 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 Processor -- start 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 -- start start 2024-09-19T08:44:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00c8101de0 0x7f00c8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00c8106f10 0x7f00c819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f00c8111e20 con 0x7f00c8102790 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f00c8111ca0 con 0x7f00c8101de0 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00cf95a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00c8111fa0 con 0x7f00c8106f10 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00ccef5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00ccef5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51362/0 (socket says 172.21.15.18:51362) 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.939+0000 7f00ccef5640 1 -- 172.21.15.18:0/1194355183 learned_addr learned my addr 172.21.15.18:0/1194355183 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00cd6f6640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00c8101de0 0x7f00c8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00cdef7640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00c8106f10 0x7f00c819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00ccef5640 1 -- 172.21.15.18:0/1194355183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00c8106f10 msgr2=0x7f00c819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00ccef5640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00c8106f10 0x7f00c819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00ccef5640 1 -- 172.21.15.18:0/1194355183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00c8101de0 msgr2=0x7f00c8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00ccef5640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00c8101de0 0x7f00c8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00ccef5640 1 -- 172.21.15.18:0/1194355183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c819d310 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00ccef5640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81988a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f00b8005940 tx=0x7f00b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b803f030 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c819d5a0 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00b8003aa0 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b8035070 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.940+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c81a4ee0 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.941+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c81032c0 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.942+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f00b8042030 con 0x7f00c8102790 2024-09-19T08:44:18.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.943+0000 7f00be7fc640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00b40a32d0 0x7f00b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.943+0000 7f00cd6f6640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00b40a32d0 0x7f00b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.943+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f00b80f0390 con 0x7f00c8102790 2024-09-19T08:44:18.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.943+0000 7f00cd6f6640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00b40a32d0 0x7f00b40a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00c4005fd0 tx=0x7f00c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:18.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:18.947+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00b80bcb90 con 0x7f00c8102790 2024-09-19T08:44:19.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.127+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00c810a0f0 con 0x7f00c8102790 2024-09-19T08:44:19.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.129+0000 7f00be7fc640 1 -- 172.21.15.18:0/1194355183 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24718 (secure 0 0 0) 0x7f00b80bc490 con 0x7f00c8102790 2024-09-19T08:44:19.129 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:19.129 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:44:18.292513+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00b40a32d0 msgr2=0x7f00b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00b40a32d0 0x7f00b40a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00c4005fd0 tx=0x7f00c4005850 comp rx=0 tx=0).stop 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 msgr2=0x7f00c81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81988a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f00b8005940 tx=0x7f00b8004270 comp rx=0 tx=0).stop 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 shutdown_connections 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f00b40a32d0 0x7f00b40a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00c8106f10 0x7f00c819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00c8102790 0x7f00c81988a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 --2- 172.21.15.18:0/1194355183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00c8101de0 0x7f00c8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 >> 172.21.15.18:0/1194355183 conn(0x7f00c80fd8c0 msgr2=0x7f00c80fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:19.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 shutdown_connections 2024-09-19T08:44:19.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:19.131+0000 7f00cf95a640 1 -- 172.21.15.18:0/1194355183 wait complete. 2024-09-19T08:44:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T08:44:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T08:44:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:44:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-19T08:44:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T08:44:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:44:19.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:19 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1194355183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T08:44:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:44:19.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:19 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1194355183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-19T08:44:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T08:44:19.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T08:44:19.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T08:44:19.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:44:19.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:19 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1194355183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:19.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T08:44:19.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T08:44:19.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T08:44:19.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T08:44:19.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T08:44:19.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T08:44:19.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T08:44:19.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T08:44:19.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T08:44:19.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T08:44:19.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T08:44:19.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T08:44:20.548 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:20.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:20 smithi150 ceph-mon[34610]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:44:20.594 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:20.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:20 smithi162 ceph-mon[34870]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:44:20.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:20 smithi018 ceph-mon[30956]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 -- 172.21.15.18:0/1755113366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 msgr2=0x7facbc10ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 --2- 172.21.15.18:0/1755113366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc10ec10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7facb4009cd0 tx=0x7facb402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 -- 172.21.15.18:0/1755113366 shutdown_connections 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 --2- 172.21.15.18:0/1755113366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc10ec10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 --2- 172.21.15.18:0/1755113366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facbc103720 0x7facbc107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 --2- 172.21.15.18:0/1755113366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facbc102d70 0x7facbc103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 -- 172.21.15.18:0/1755113366 >> 172.21.15.18:0/1755113366 conn(0x7facbc0fc7d0 msgr2=0x7facbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 -- 172.21.15.18:0/1755113366 shutdown_connections 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 -- 172.21.15.18:0/1755113366 wait complete. 2024-09-19T08:44:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.362+0000 7facc373c640 1 Processor -- start 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 -- start start 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facbc102d70 0x7facbc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facbc103720 0x7facbc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7facbc111f70 con 0x7facbc1082a0 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7facbc111df0 con 0x7facbc102d70 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc373c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7facbc1120f0 con 0x7facbc103720 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42150/0 (socket says 172.21.15.18:42150) 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 -- 172.21.15.18:0/152813754 learned_addr learned my addr 172.21.15.18:0/152813754 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc14d8640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facbc102d70 0x7facbc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc0cd7640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facbc103720 0x7facbc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 -- 172.21.15.18:0/152813754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facbc103720 msgr2=0x7facbc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facbc103720 0x7facbc198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 -- 172.21.15.18:0/152813754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facbc102d70 msgr2=0x7facbc1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.363+0000 7facc1cd9640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facbc102d70 0x7facbc1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facc1cd9640 1 -- 172.21.15.18:0/152813754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc19d3a0 con 0x7facbc1082a0 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facc1cd9640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc19ccc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7facb4005cc0 tx=0x7facb4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4004240 con 0x7facbc1082a0 2024-09-19T08:44:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facbc19d630 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facb40305a0 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40466c0 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.364+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facbc1a4f70 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.365+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7facbc062980 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.366+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7facb4030ac0 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facb27fc640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faca80a32d0 0x7faca80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facc14d8640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faca80a32d0 0x7faca80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7facb402e030 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facb27fc640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] conn(0x7faca80ae4a0 0x7faca80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 --> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faca80b1010 con 0x7faca80ae4a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7facb40f8050 con 0x7facbc1082a0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.367+0000 7facc0cd7640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] conn(0x7faca80ae4a0 0x7faca80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.368+0000 7facc14d8640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faca80a32d0 0x7faca80a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7facb800abe0 tx=0x7facb800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.368+0000 7facc0cd7640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] conn(0x7faca80ae4a0 0x7faca80b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.369+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== osd.9 v2:172.21.15.18:6826/4029412965 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faca80b1010 con 0x7faca80ae4a0 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.382+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 --> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7facbc062e00 con 0x7faca80ae4a0 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facb27fc640 1 -- 172.21.15.18:0/152813754 <== osd.9 v2:172.21.15.18:6826/4029412965 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7facbc062e00 con 0x7faca80ae4a0 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] conn(0x7faca80ae4a0 msgr2=0x7faca80b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] conn(0x7faca80ae4a0 0x7faca80b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faca80a32d0 msgr2=0x7faca80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7faca80a32d0 0x7faca80a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7facb800abe0 tx=0x7facb800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 msgr2=0x7facbc19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 --2- 172.21.15.18:0/152813754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facbc1082a0 0x7facbc19ccc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7facb4005cc0 tx=0x7facb4003ba0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc1cd9640 1 -- 172.21.15.18:0/152813754 reap_dead start 2024-09-19T08:44:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 shutdown_connections 2024-09-19T08:44:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 >> 172.21.15.18:0/152813754 conn(0x7facbc0fc7d0 msgr2=0x7facbc105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 shutdown_connections 2024-09-19T08:44:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:21.383+0000 7facc373c640 1 -- 172.21.15.18:0/152813754 wait complete. 2024-09-19T08:44:21.397 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:21 smithi150 ceph-mon[34610]: pgmap v319: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-09-19T08:44:21.651 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:21 smithi018 ceph-mon[30956]: pgmap v319: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-09-19T08:44:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:21 smithi162 ceph-mon[34870]: pgmap v319: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-09-19T08:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout:266287972389 2024-09-19T08:44:22.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T08:44:22.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.605+0000 7f0c57814640 1 -- 172.21.15.18:0/766467679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 msgr2=0x7f0c50110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.605+0000 7f0c57814640 1 --2- 172.21.15.18:0/766467679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c50110810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009ca0 tx=0x7f0c4802a950 comp rx=0 tx=0).stop 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.605+0000 7f0c57814640 1 -- 172.21.15.18:0/766467679 shutdown_connections 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.605+0000 7f0c57814640 1 --2- 172.21.15.18:0/766467679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c50110810 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.605+0000 7f0c57814640 1 --2- 172.21.15.18:0/766467679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c50074f40 0x7f0c5010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.605+0000 7f0c57814640 1 --2- 172.21.15.18:0/766467679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c50074620 0x7f0c50074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.606+0000 7f0c57814640 1 -- 172.21.15.18:0/766467679 >> 172.21.15.18:0/766467679 conn(0x7f0c500fd8c0 msgr2=0x7f0c500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.606+0000 7f0c57814640 1 -- 172.21.15.18:0/766467679 shutdown_connections 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.606+0000 7f0c57814640 1 -- 172.21.15.18:0/766467679 wait complete. 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.606+0000 7f0c57814640 1 Processor -- start 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.606+0000 7f0c57814640 1 -- start start 2024-09-19T08:44:22.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c57814640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c50074620 0x7f0c5019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c57814640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c50074f40 0x7f0c5019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c57814640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c5019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c57814640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50114010 con 0x7f0c5010e3c0 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c57814640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50113e90 con 0x7f0c50074620 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c57814640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50114190 con 0x7f0c50074f40 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c5019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c5019eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42174/0 (socket says 172.21.15.18:42174) 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 -- 172.21.15.18:0/19847848 learned_addr learned my addr 172.21.15.18:0/19847848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c54daf640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c50074f40 0x7f0c5019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c555b0640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c50074620 0x7f0c5019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 -- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c50074f40 msgr2=0x7f0c5019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c50074f40 0x7f0c5019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 -- 172.21.15.18:0/19847848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c50074620 msgr2=0x7f0c5019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c50074620 0x7f0c5019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 -- 172.21.15.18:0/19847848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5019f480 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c54daf640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c50074f40 0x7f0c5019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c555b0640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c50074620 0x7f0c5019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.607+0000 7f0c55db1640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c5019eda0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0c4802ae70 tx=0x7f0c4802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.608+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48034040 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.608+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c480308f0 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.608+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5019f710 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.608+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480047f0 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.608+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501a7050 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.609+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c50062980 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.610+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0c48037020 con 0x7f0c5010e3c0 2024-09-19T08:44:22.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c467fc640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0c3c0a3350 0x7f0c3c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c555b0640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0c3c0a3350 0x7f0c3c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f0c480f11b0 con 0x7f0c5010e3c0 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c467fc640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] conn(0x7f0c3c0ae520 0x7f0c3c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 --> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c48044ec0 con 0x7f0c3c0ae520 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f0c480f1560 con 0x7f0c5010e3c0 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c555b0640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0c3c0a3350 0x7f0c3c0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0058c0 tx=0x7f0c4c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.611+0000 7f0c54daf640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] conn(0x7f0c3c0ae520 0x7f0c3c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.612+0000 7f0c54daf640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] conn(0x7f0c3c0ae520 0x7f0c3c0b09c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.612+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== osd.11 v2:172.21.15.162:6824/3933246322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c48044ec0 con 0x7f0c3c0ae520 2024-09-19T08:44:22.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.626+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 --> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c50062d80 con 0x7f0c3c0ae520 2024-09-19T08:44:22.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c467fc640 1 -- 172.21.15.18:0/19847848 <== osd.11 v2:172.21.15.162:6824/3933246322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0c50062d80 con 0x7f0c3c0ae520 2024-09-19T08:44:22.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] conn(0x7f0c3c0ae520 msgr2=0x7f0c3c0b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:22.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] conn(0x7f0c3c0ae520 0x7f0c3c0b09c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0c3c0a3350 msgr2=0x7f0c3c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:22.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f0c3c0a3350 0x7f0c3c0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0058c0 tx=0x7f0c4c005850 comp rx=0 tx=0).stop 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 msgr2=0x7f0c5019eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 --2- 172.21.15.18:0/19847848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5010e3c0 0x7f0c5019eda0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0c4802ae70 tx=0x7f0c4802f5d0 comp rx=0 tx=0).stop 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c55db1640 1 -- 172.21.15.18:0/19847848 reap_dead start 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 shutdown_connections 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 >> 172.21.15.18:0/19847848 conn(0x7f0c500fd8c0 msgr2=0x7f0c500fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 shutdown_connections 2024-09-19T08:44:22.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.627+0000 7f0c57814640 1 -- 172.21.15.18:0/19847848 wait complete. 2024-09-19T08:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout:317827579932 2024-09-19T08:44:23.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T08:44:23.334 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.335 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.335 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.339 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.341 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.341 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.346 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 -- 172.21.15.18:0/588467682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984102d30 msgr2=0x7f7984103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 --2- 172.21.15.18:0/588467682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984102d30 0x7f7984103110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7974009930 tx=0x7f797402a440 comp rx=0 tx=0).stop 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 -- 172.21.15.18:0/588467682 shutdown_connections 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 --2- 172.21.15.18:0/588467682 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79841082a0 0x7f798410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 --2- 172.21.15.18:0/588467682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79841036e0 0x7f7984107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 --2- 172.21.15.18:0/588467682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984102d30 0x7f7984103110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 -- 172.21.15.18:0/588467682 >> 172.21.15.18:0/588467682 conn(0x7f79840fc7d0 msgr2=0x7f79840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 -- 172.21.15.18:0/588467682 shutdown_connections 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.505+0000 7f7989c37640 1 -- 172.21.15.18:0/588467682 wait complete. 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 Processor -- start 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 -- start start 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7984102d30 0x7f7984198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79841036e0 0x7f7984198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79841082a0 0x7f798419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7984111f90 con 0x7f79841082a0 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7984111e10 con 0x7f7984102d30 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7989c37640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7984112110 con 0x7f79841036e0 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7983fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79841082a0 0x7f798419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7983fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79841082a0 0x7f798419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42156/0 (socket says 172.21.15.18:42156) 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7983fff640 1 -- 172.21.15.18:0/2252451531 learned_addr learned my addr 172.21.15.18:0/2252451531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f7982ffd640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79841036e0 0x7f7984198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.506+0000 7f79837fe640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7984102d30 0x7f7984198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7983fff640 1 -- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79841036e0 msgr2=0x7f7984198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7983fff640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79841036e0 0x7f7984198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7983fff640 1 -- 172.21.15.18:0/2252451531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7984102d30 msgr2=0x7f7984198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7983fff640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7984102d30 0x7f7984198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7983fff640 1 -- 172.21.15.18:0/2252451531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798419d4c0 con 0x7f79841082a0 2024-09-19T08:44:23.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7983fff640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79841082a0 0x7f798419cde0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f797c00cce0 tx=0x7f797c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c00f450 con 0x7f79841082a0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f797c00faa0 con 0x7f79841082a0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798419d7b0 con 0x7f79841082a0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c018a80 con 0x7f79841082a0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.507+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79841a5090 con 0x7f79841082a0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.508+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7984062980 con 0x7f79841082a0 2024-09-19T08:44:23.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.509+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f797c00fc50 con 0x7f79841082a0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f7980ff9640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f796c0a3350 0x7f796c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f79837fe640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f796c0a3350 0x7f796c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f797c0d05a0 con 0x7f79841082a0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f7980ff9640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] conn(0x7f796c0ae520 0x7f796c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 --> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f796c0b1090 con 0x7f796c0ae520 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f797c0d09f0 con 0x7f79841082a0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.510+0000 7f79837fe640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f796c0a3350 0x7f796c0a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7974006010 tx=0x7f7974000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.511+0000 7f7982ffd640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] conn(0x7f796c0ae520 0x7f796c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.511+0000 7f7982ffd640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] conn(0x7f796c0ae520 0x7f796c0b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.512+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== osd.5 v2:172.21.15.162:6808/2688421502 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f796c0b1090 con 0x7f796c0ae520 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.526+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 --> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7984062e00 con 0x7f796c0ae520 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.526+0000 7f7980ff9640 1 -- 172.21.15.18:0/2252451531 <== osd.5 v2:172.21.15.162:6808/2688421502 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7984062e00 con 0x7f796c0ae520 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] conn(0x7f796c0ae520 msgr2=0x7f796c0b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] conn(0x7f796c0ae520 0x7f796c0b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f796c0a3350 msgr2=0x7f796c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f796c0a3350 0x7f796c0a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7974006010 tx=0x7f7974000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79841082a0 msgr2=0x7f798419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 --2- 172.21.15.18:0/2252451531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79841082a0 0x7f798419cde0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f797c00cce0 tx=0x7f797c00a620 comp rx=0 tx=0).stop 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7983fff640 1 -- 172.21.15.18:0/2252451531 reap_dead start 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 shutdown_connections 2024-09-19T08:44:23.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 >> 172.21.15.18:0/2252451531 conn(0x7f79840fc7d0 msgr2=0x7f7984105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 shutdown_connections 2024-09-19T08:44:23.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:22.527+0000 7f7989c37640 1 -- 172.21.15.18:0/2252451531 wait complete. 2024-09-19T08:44:23.643 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:23 smithi162 ceph-mon[34870]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:23.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:23 smithi018 ceph-mon[30956]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:23.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:23 smithi150 ceph-mon[34610]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:24.087 INFO:teuthology.orchestra.run.smithi018.stdout:154618822714 2024-09-19T08:44:24.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T08:44:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 -- 172.21.15.18:0/2740921547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c101de0 msgr2=0x7fb06c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2740921547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c101de0 0x7fb06c1021c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009900 tx=0x7fb05c02a410 comp rx=0 tx=0).stop 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 -- 172.21.15.18:0/2740921547 shutdown_connections 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2740921547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c106f10 0x7fb06c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2740921547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb06c102790 0x7fb06c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2740921547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c101de0 0x7fb06c1021c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 -- 172.21.15.18:0/2740921547 >> 172.21.15.18:0/2740921547 conn(0x7fb06c0fd8c0 msgr2=0x7fb06c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 -- 172.21.15.18:0/2740921547 shutdown_connections 2024-09-19T08:44:24.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.747+0000 7fb071b5f640 1 -- 172.21.15.18:0/2740921547 wait complete. 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 Processor -- start 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 -- start start 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c101de0 0x7fb06c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c102790 0x7fb06c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb06c106f10 0x7fb06c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111de0 con 0x7fb06c102790 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111c60 con 0x7fb06c106f10 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb071b5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111f60 con 0x7fb06c101de0 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb06affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c102790 0x7fb06c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb06affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c102790 0x7fb06c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42182/0 (socket says 172.21.15.18:42182) 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.748+0000 7fb06affd640 1 -- 172.21.15.18:0/2407400611 learned_addr learned my addr 172.21.15.18:0/2407400611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06b7fe640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c101de0 0x7fb06c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06bfff640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb06c106f10 0x7fb06c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06affd640 1 -- 172.21.15.18:0/2407400611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c101de0 msgr2=0x7fb06c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06affd640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c101de0 0x7fb06c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06affd640 1 -- 172.21.15.18:0/2407400611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb06c106f10 msgr2=0x7fb06c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06affd640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb06c106f10 0x7fb06c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06affd640 1 -- 172.21.15.18:0/2407400611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c1a6800 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb06affd640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c102790 0x7fb06c074a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c890 tx=0x7fb06000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060004220 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c1a6af0 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0600043c0 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060004a00 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.749+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c1a7080 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.750+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb06c0628c0 con 0x7fb06c102790 2024-09-19T08:44:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.751+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb060004ba0 con 0x7fb06c102790 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb068ff9640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0540a32d0 0x7fb0540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb06b7fe640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0540a32d0 0x7fb0540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb0600cffe0 con 0x7fb06c102790 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb068ff9640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] conn(0x7fb0540ae4a0 0x7fb0540b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 --> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb060023ef0 con 0x7fb0540ae4a0 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fb0600d0430 con 0x7fb06c102790 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.752+0000 7fb06bfff640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] conn(0x7fb0540ae4a0 0x7fb0540b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.753+0000 7fb06b7fe640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0540a32d0 0x7fb0540a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb05c031440 tx=0x7fb05c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.753+0000 7fb06bfff640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] conn(0x7fb0540ae4a0 0x7fb0540b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.754+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== osd.6 v2:172.21.15.18:6818/3727051065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb060023ef0 con 0x7fb0540ae4a0 2024-09-19T08:44:24.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.768+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 --> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb06c062cc0 con 0x7fb0540ae4a0 2024-09-19T08:44:24.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.768+0000 7fb068ff9640 1 -- 172.21.15.18:0/2407400611 <== osd.6 v2:172.21.15.18:6818/3727051065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb06c062cc0 con 0x7fb0540ae4a0 2024-09-19T08:44:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.768+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] conn(0x7fb0540ae4a0 msgr2=0x7fb0540b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.768+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] conn(0x7fb0540ae4a0 0x7fb0540b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0540a32d0 msgr2=0x7fb0540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb0540a32d0 0x7fb0540a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb05c031440 tx=0x7fb05c0095f0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c102790 msgr2=0x7fb06c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 --2- 172.21.15.18:0/2407400611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb06c102790 0x7fb06c074a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c890 tx=0x7fb06000cd50 comp rx=0 tx=0).stop 2024-09-19T08:44:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb06bfff640 1 -- 172.21.15.18:0/2407400611 reap_dead start 2024-09-19T08:44:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 shutdown_connections 2024-09-19T08:44:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 >> 172.21.15.18:0/2407400611 conn(0x7fb06c0fd8c0 msgr2=0x7fb06c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 shutdown_connections 2024-09-19T08:44:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.769+0000 7fb071b5f640 1 -- 172.21.15.18:0/2407400611 wait complete. 2024-09-19T08:44:25.520 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:25 smithi018 ceph-mon[30956]: pgmap v321: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:25.549 INFO:teuthology.orchestra.run.smithi018.stdout:184683593780 2024-09-19T08:44:25.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T08:44:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:25 smithi162 ceph-mon[34870]: pgmap v321: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:25.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:25 smithi150 ceph-mon[34610]: pgmap v321: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.898+0000 7f0573f06640 1 -- 172.21.15.18:0/1466006338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1036e0 msgr2=0x7f056c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.898+0000 7f0573f06640 1 --2- 172.21.15.18:0/1466006338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1036e0 0x7f056c107b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0560009930 tx=0x7f056002a420 comp rx=0 tx=0).stop 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 -- 172.21.15.18:0/1466006338 shutdown_connections 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 --2- 172.21.15.18:0/1466006338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c1082a0 0x7f056c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 --2- 172.21.15.18:0/1466006338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1036e0 0x7f056c107b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 --2- 172.21.15.18:0/1466006338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 0x7f056c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 -- 172.21.15.18:0/1466006338 >> 172.21.15.18:0/1466006338 conn(0x7f056c0fc7d0 msgr2=0x7f056c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 -- 172.21.15.18:0/1466006338 shutdown_connections 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 -- 172.21.15.18:0/1466006338 wait complete. 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 Processor -- start 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.899+0000 7f0573f06640 1 -- start start 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0573f06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 0x7f056c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0573f06640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c1036e0 0x7f056c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0573f06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 0x7f056c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0573f06640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f056c111f50 con 0x7f056c1082a0 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0573f06640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f056c111dd0 con 0x7f056c102d30 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0573f06640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f056c1120d0 con 0x7f056c1036e0 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 0x7f056c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 0x7f056c19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42228/0 (socket says 172.21.15.18:42228) 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 -- 172.21.15.18:0/209669185 learned_addr learned my addr 172.21.15.18:0/209669185 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05714a1640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c1036e0 0x7f056c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0571ca2640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 0x7f056c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 -- 172.21.15.18:0/209669185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c1036e0 msgr2=0x7f056c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c1036e0 0x7f056c19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 -- 172.21.15.18:0/209669185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 msgr2=0x7f056c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 0x7f056c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 -- 172.21.15.18:0/209669185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c19f6c0 con 0x7f056c1082a0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f0571ca2640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 0x7f056c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.900+0000 7f05724a3640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 0x7f056c19efe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f056400d750 tx=0x7f056400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.901+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564017070 con 0x7f056c1082a0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.901+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05640054d0 con 0x7f056c1082a0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.901+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564004c60 con 0x7f056c1082a0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.901+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056c19f9b0 con 0x7f056c1082a0 2024-09-19T08:44:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.901+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056c1a7290 con 0x7f056c1082a0 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.902+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056c103110 con 0x7f056c1082a0 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.903+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0564004e00 con 0x7f056c1082a0 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.903+0000 7f056affd640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05540a32d0 0x7f05540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.904+0000 7f0571ca2640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05540a32d0 0x7f05540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.904+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f05640cf740 con 0x7f056c1082a0 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.904+0000 7f0571ca2640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05540a32d0 0x7f05540a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f055c005c40 tx=0x7f055c00a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.908+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f056409bfa0 con 0x7f056c1082a0 2024-09-19T08:44:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.085+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f056c10c2c0 con 0x7f056c1082a0 2024-09-19T08:44:27.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.086+0000 7f056affd640 1 -- 172.21.15.18:0/209669185 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f056409b8a0 con 0x7f056c1082a0 2024-09-19T08:44:27.086 INFO:teuthology.orchestra.run.smithi018.stdout:266287972390 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05540a32d0 msgr2=0x7f05540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05540a32d0 0x7f05540a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f055c005c40 tx=0x7f055c00a430 comp rx=0 tx=0).stop 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 msgr2=0x7f056c19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 0x7f056c19efe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f056400d750 tx=0x7f056400dc10 comp rx=0 tx=0).stop 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 shutdown_connections 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f05540a32d0 0x7f05540a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c1082a0 0x7f056c19efe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c1036e0 0x7f056c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 --2- 172.21.15.18:0/209669185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c102d30 0x7f056c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 >> 172.21.15.18:0/209669185 conn(0x7f056c0fc7d0 msgr2=0x7f056c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:27.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 shutdown_connections 2024-09-19T08:44:27.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.088+0000 7f0573f06640 1 -- 172.21.15.18:0/209669185 wait complete. 2024-09-19T08:44:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3665580725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481036e0 msgr2=0x7f7a48107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3665580725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481036e0 0x7f7a48107b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009930 tx=0x7f7a3402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3665580725 shutdown_connections 2024-09-19T08:44:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3665580725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a481082a0 0x7f7a4810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3665580725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481036e0 0x7f7a48107b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3665580725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a48102d30 0x7f7a48103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3665580725 >> 172.21.15.18:0/3665580725 conn(0x7f7a480fc7d0 msgr2=0x7f7a480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3665580725 shutdown_connections 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.130+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3665580725 wait complete. 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 Processor -- start 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 -- start start 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a48102d30 0x7f7a48100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a481036e0 0x7f7a48100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481082a0 0x7f7a48101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48111f50 con 0x7f7a481082a0 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48111dd0 con 0x7f7a48102d30 2024-09-19T08:44:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4eaa2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481120d0 con 0x7f7a481036e0 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481082a0 0x7f7a48101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481082a0 0x7f7a48101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42246/0 (socket says 172.21.15.18:42246) 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 -- 172.21.15.18:0/3079212273 learned_addr learned my addr 172.21.15.18:0/3079212273 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4c83e640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a48102d30 0x7f7a48100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a47fff640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a481036e0 0x7f7a48100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 -- 172.21.15.18:0/3079212273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a481036e0 msgr2=0x7f7a48100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a481036e0 0x7f7a48100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 -- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a48102d30 msgr2=0x7f7a48100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a48102d30 0x7f7a48100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.131+0000 7f7a4d03f640 1 -- 172.21.15.18:0/3079212273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a481a6a40 con 0x7f7a481082a0 2024-09-19T08:44:27.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.132+0000 7f7a4d03f640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481082a0 0x7f7a48101410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000eaa0 tx=0x7f7a4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:27.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.132+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000cdb0 con 0x7f7a481082a0 2024-09-19T08:44:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.132+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a40005020 con 0x7f7a481082a0 2024-09-19T08:44:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.132+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a481a6d30 con 0x7f7a481082a0 2024-09-19T08:44:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.132+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a400116d0 con 0x7f7a481082a0 2024-09-19T08:44:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.132+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a481a7290 con 0x7f7a481082a0 2024-09-19T08:44:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.133+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a480628c0 con 0x7f7a481082a0 2024-09-19T08:44:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.134+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7a400051d0 con 0x7f7a481082a0 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a45ffb640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7a380a3350 0x7f7a380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a4c83e640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7a380a3350 0x7f7a380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f7a400d0300 con 0x7f7a481082a0 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a45ffb640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] conn(0x7f7a380ae520 0x7f7a380b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 --> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a4001be50 con 0x7f7a380ae520 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f7a400d06b0 con 0x7f7a481082a0 2024-09-19T08:44:27.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a47fff640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] conn(0x7f7a380ae520 0x7f7a380b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.135+0000 7f7a4c83e640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7a380a3350 0x7f7a380a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0058c0 tx=0x7f7a3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.136+0000 7f7a47fff640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] conn(0x7f7a380ae520 0x7f7a380b09c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.137+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== osd.1 v2:172.21.15.150:6800/1031941891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a4001be50 con 0x7f7a380ae520 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.150+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 --> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a48062cc0 con 0x7f7a380ae520 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a45ffb640 1 -- 172.21.15.18:0/3079212273 <== osd.1 v2:172.21.15.150:6800/1031941891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7a48062cc0 con 0x7f7a380ae520 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] conn(0x7f7a380ae520 msgr2=0x7f7a380b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] conn(0x7f7a380ae520 0x7f7a380b09c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7a380a3350 msgr2=0x7f7a380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7a380a3350 0x7f7a380a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0058c0 tx=0x7f7a3c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481082a0 msgr2=0x7f7a48101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 --2- 172.21.15.18:0/3079212273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a481082a0 0x7f7a48101410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000eaa0 tx=0x7f7a4000ef60 comp rx=0 tx=0).stop 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4d03f640 1 -- 172.21.15.18:0/3079212273 reap_dead start 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 shutdown_connections 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 >> 172.21.15.18:0/3079212273 conn(0x7f7a480fc7d0 msgr2=0x7f7a48105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 shutdown_connections 2024-09-19T08:44:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:27.151+0000 7f7a4eaa2640 1 -- 172.21.15.18:0/3079212273 wait complete. 2024-09-19T08:44:27.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 -- 172.21.15.18:0/1011531590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 msgr2=0x7fa9641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/1011531590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa9641067e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa954009900 tx=0x7fa95402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 -- 172.21.15.18:0/1011531590 shutdown_connections 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/1011531590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f10 0x7fa96410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/1011531590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa9641067e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/1011531590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa964101de0 0x7fa9641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 -- 172.21.15.18:0/1011531590 >> 172.21.15.18:0/1011531590 conn(0x7fa9640fd8c0 msgr2=0x7fa9640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 -- 172.21.15.18:0/1011531590 shutdown_connections 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 -- 172.21.15.18:0/1011531590 wait complete. 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 Processor -- start 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.309+0000 7fa96c6c6640 1 -- start start 2024-09-19T08:44:27.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96c6c6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa964101de0 0x7fa9640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96c6c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa964074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96c6c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f10 0x7fa964074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96c6c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa964111e20 con 0x7fa964102790 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96c6c6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa964111ca0 con 0x7fa964101de0 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96c6c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa964111fa0 con 0x7fa964106f10 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa964074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa964074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42224/0 (socket says 172.21.15.18:42224) 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 -- 172.21.15.18:0/486773951 learned_addr learned my addr 172.21.15.18:0/486773951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96a462640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa964101de0 0x7fa9640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96ac63640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f10 0x7fa964074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 -- 172.21.15.18:0/486773951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f10 msgr2=0x7fa964074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f10 0x7fa964074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 -- 172.21.15.18:0/486773951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa964101de0 msgr2=0x7fa9640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa964101de0 0x7fa9640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 -- 172.21.15.18:0/486773951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9641a6880 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa96ac63640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f10 0x7fa964074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.310+0000 7fa969c61640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa964074a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa954005940 tx=0x7fa954004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.311+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95403f030 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.311+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9641a6b10 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.311+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa954003aa0 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.311+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954035070 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.311+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9641a7040 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.311+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9640628c0 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.313+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa954042030 con 0x7fa964102790 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.313+0000 7fa95b7fe640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa9500a32d0 0x7fa9500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.313+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa9540f0c80 con 0x7fa964102790 2024-09-19T08:44:27.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.313+0000 7fa96a462640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa9500a32d0 0x7fa9500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.314+0000 7fa95b7fe640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] conn(0x7fa9500ae4a0 0x7fa9500b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:27.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.314+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 --> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa954001d30 con 0x7fa9500ae4a0 2024-09-19T08:44:27.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.314+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fa9540f10d0 con 0x7fa964102790 2024-09-19T08:44:27.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.314+0000 7fa96ac63640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] conn(0x7fa9500ae4a0 0x7fa9500b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:27.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.314+0000 7fa96a462640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa9500a32d0 0x7fa9500a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9600058c0 tx=0x7fa96000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.314+0000 7fa96ac63640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] conn(0x7fa9500ae4a0 0x7fa9500b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.315+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== osd.3 v2:172.21.15.18:6810/830246499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa954001d30 con 0x7fa9500ae4a0 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.328+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 --> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa964062cc0 con 0x7fa9500ae4a0 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa95b7fe640 1 -- 172.21.15.18:0/486773951 <== osd.3 v2:172.21.15.18:6810/830246499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa964062cc0 con 0x7fa9500ae4a0 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] conn(0x7fa9500ae4a0 msgr2=0x7fa9500b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] conn(0x7fa9500ae4a0 0x7fa9500b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa9500a32d0 msgr2=0x7fa9500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa9500a32d0 0x7fa9500a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9600058c0 tx=0x7fa96000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 msgr2=0x7fa964074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 --2- 172.21.15.18:0/486773951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102790 0x7fa964074a30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa954005940 tx=0x7fa954004270 comp rx=0 tx=0).stop 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96ac63640 1 -- 172.21.15.18:0/486773951 reap_dead start 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 shutdown_connections 2024-09-19T08:44:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 >> 172.21.15.18:0/486773951 conn(0x7fa9640fd8c0 msgr2=0x7fa9640fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 shutdown_connections 2024-09-19T08:44:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:26.329+0000 7fa96c6c6640 1 -- 172.21.15.18:0/486773951 wait complete. 2024-09-19T08:44:27.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:27 smithi018 ceph-mon[30956]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 638 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:27.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/209669185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:44:27.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:27 smithi162 ceph-mon[34870]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 638 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:27.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:27 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/209669185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:44:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:27 smithi150 ceph-mon[34610]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 638 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T08:44:27.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:27 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/209669185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:44:28.089 INFO:teuthology.orchestra.run.smithi018.stdout:103079215173 2024-09-19T08:44:28.090 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2628619831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 msgr2=0x7f2c8810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2628619831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8810ec70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009cd0 tx=0x7f2c8002a8d0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2628619831 shutdown_connections 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2628619831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8810ec70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2628619831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c88103780 0x7f2c88107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2628619831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c88102dd0 0x7f2c881031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2628619831 >> 172.21.15.18:0/2628619831 conn(0x7f2c880fc7d0 msgr2=0x7f2c880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2628619831 shutdown_connections 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2628619831 wait complete. 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.964+0000 7f2c8e03a640 1 Processor -- start 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 -- start start 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c88102dd0 0x7f2c88198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c88103780 0x7f2c88198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111f80 con 0x7f2c88108300 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111e00 con 0x7f2c88103780 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c8e03a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88112100 con 0x7f2c88102dd0 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c87fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:28.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c87fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42200/0 (socket says 172.21.15.18:42200) 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c87fff640 1 -- 172.21.15.18:0/2189037992 learned_addr learned my addr 172.21.15.18:0/2189037992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c877fe640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c88102dd0 0x7f2c88198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.965+0000 7f2c86ffd640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c88103780 0x7f2c88198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c87fff640 1 -- 172.21.15.18:0/2189037992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c88102dd0 msgr2=0x7f2c88198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c87fff640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c88102dd0 0x7f2c88198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c87fff640 1 -- 172.21.15.18:0/2189037992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c88103780 msgr2=0x7f2c88198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c87fff640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c88103780 0x7f2c88198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c87fff640 1 -- 172.21.15.18:0/2189037992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8819d3f0 con 0x7f2c88108300 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c87fff640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8819cd10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005cc0 tx=0x7f2c80032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80031860 con 0x7f2c88108300 2024-09-19T08:44:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c80003b70 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8819d680 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800307f0 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.966+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c881a4fc0 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.967+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c88062980 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.969+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2c80004040 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.969+0000 7f2c84ff9640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2c700a32d0 0x7f2c700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.969+0000 7f2c877fe640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2c700a32d0 0x7f2c700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.969+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f2c800f0ed0 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.970+0000 7f2c84ff9640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] conn(0x7f2c700ae420 0x7f2c700b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.970+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 --> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c800020b0 con 0x7f2c700ae420 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.970+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f2c800f1320 con 0x7f2c88108300 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.970+0000 7f2c86ffd640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] conn(0x7f2c700ae420 0x7f2c700b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.970+0000 7f2c877fe640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2c700a32d0 0x7f2c700a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800abe0 tx=0x7f2c7800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.970+0000 7f2c86ffd640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] conn(0x7f2c700ae420 0x7f2c700b08c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.971+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== osd.0 v2:172.21.15.18:6802/2521385669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c800020b0 con 0x7f2c700ae420 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.984+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 --> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c88062e00 con 0x7f2c700ae420 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c84ff9640 1 -- 172.21.15.18:0/2189037992 <== osd.0 v2:172.21.15.18:6802/2521385669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2c88062e00 con 0x7f2c700ae420 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] conn(0x7f2c700ae420 msgr2=0x7f2c700b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] conn(0x7f2c700ae420 0x7f2c700b08c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2c700a32d0 msgr2=0x7f2c700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2c700a32d0 0x7f2c700a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800abe0 tx=0x7f2c7800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 msgr2=0x7f2c8819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 --2- 172.21.15.18:0/2189037992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c88108300 0x7f2c8819cd10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005cc0 tx=0x7f2c80032cf0 comp rx=0 tx=0).stop 2024-09-19T08:44:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c87fff640 1 -- 172.21.15.18:0/2189037992 reap_dead start 2024-09-19T08:44:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 shutdown_connections 2024-09-19T08:44:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.985+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 >> 172.21.15.18:0/2189037992 conn(0x7f2c880fc7d0 msgr2=0x7f2c88105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.986+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 shutdown_connections 2024-09-19T08:44:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:24.986+0000 7f2c8e03a640 1 -- 172.21.15.18:0/2189037992 wait complete. 2024-09-19T08:44:28.915 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:29.383 INFO:teuthology.orchestra.run.smithi018.stdout:34359738451 2024-09-19T08:44:29.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T08:44:29.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:29 smithi018 ceph-mon[30956]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 60 B/s, 0 objects/s recovering 2024-09-19T08:44:29.617 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:29 smithi150 ceph-mon[34610]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 60 B/s, 0 objects/s recovering 2024-09-19T08:44:29.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:29 smithi162 ceph-mon[34870]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 60 B/s, 0 objects/s recovering 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 -- 172.21.15.18:0/1222581113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774100a80 msgr2=0x7f0774100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 --2- 172.21.15.18:0/1222581113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774100a80 0x7f0774100ee0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0764009930 tx=0x7f076402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 -- 172.21.15.18:0/1222581113 shutdown_connections 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 --2- 172.21.15.18:0/1222581113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0774101420 0x7f077410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 --2- 172.21.15.18:0/1222581113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774100a80 0x7f0774100ee0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 --2- 172.21.15.18:0/1222581113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0774106a80 0x7f0774106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 -- 172.21.15.18:0/1222581113 >> 172.21.15.18:0/1222581113 conn(0x7f07740fc7a0 msgr2=0x7f07740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:29.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 -- 172.21.15.18:0/1222581113 shutdown_connections 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.876+0000 7f077c437640 1 -- 172.21.15.18:0/1222581113 wait complete. 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 Processor -- start 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 -- start start 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0774100a80 0x7f07741983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774101420 0x7f07741988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0774106a80 0x7f077419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0774111e50 con 0x7f0774101420 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0774111cd0 con 0x7f0774106a80 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f077c437640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0774111fd0 con 0x7f0774100a80 2024-09-19T08:44:29.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f07799d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774101420 0x7f07741988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f07799d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774101420 0x7f07741988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42210/0 (socket says 172.21.15.18:42210) 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.877+0000 7f07799d2640 1 -- 172.21.15.18:0/2666904333 learned_addr learned my addr 172.21.15.18:0/2666904333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f077a1d3640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0774100a80 0x7f07741983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f077a9d4640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0774106a80 0x7f077419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f07799d2640 1 -- 172.21.15.18:0/2666904333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0774100a80 msgr2=0x7f07741983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f07799d2640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0774100a80 0x7f07741983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f07799d2640 1 -- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0774106a80 msgr2=0x7f077419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:29.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f07799d2640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0774106a80 0x7f077419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f07799d2640 1 -- 172.21.15.18:0/2666904333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077419d360 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f07799d2640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774101420 0x7f07741988f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0764004770 tx=0x7f07640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076403f070 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f076403b460 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077419d5f0 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764035070 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.878+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07741a4f30 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.879+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0774062980 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.880+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f076403b610 con 0x7f0774101420 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.881+0000 7f076b7fe640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f07600a3350 0x7f07600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.881+0000 7f077a1d3640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f07600a3350 0x7f07600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:29.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.881+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f07640f0710 con 0x7f0774101420 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.881+0000 7f076b7fe640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] conn(0x7f07600ae520 0x7f07600b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.881+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 --> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0764001d30 con 0x7f07600ae520 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.881+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f07640f0b60 con 0x7f0774101420 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.882+0000 7f077a1d3640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f07600a3350 0x7f07600a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0770005fd0 tx=0x7f077000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.882+0000 7f077a9d4640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] conn(0x7f07600ae520 0x7f07600b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.882+0000 7f077a9d4640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] conn(0x7f07600ae520 0x7f07600b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.883+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== osd.4 v2:172.21.15.150:6808/3531191776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0764001d30 con 0x7f07600ae520 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.898+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 --> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0774062d80 con 0x7f07600ae520 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.898+0000 7f076b7fe640 1 -- 172.21.15.18:0/2666904333 <== osd.4 v2:172.21.15.150:6808/3531191776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0774062d80 con 0x7f07600ae520 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] conn(0x7f07600ae520 msgr2=0x7f07600b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] conn(0x7f07600ae520 0x7f07600b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f07600a3350 msgr2=0x7f07600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:29.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f07600a3350 0x7f07600a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0770005fd0 tx=0x7f077000b390 comp rx=0 tx=0).stop 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774101420 msgr2=0x7f07741988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 --2- 172.21.15.18:0/2666904333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0774101420 0x7f07741988f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0764004770 tx=0x7f07640042f0 comp rx=0 tx=0).stop 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077a9d4640 1 -- 172.21.15.18:0/2666904333 reap_dead start 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 shutdown_connections 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 >> 172.21.15.18:0/2666904333 conn(0x7f07740fc7a0 msgr2=0x7f07740fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 shutdown_connections 2024-09-19T08:44:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:29.899+0000 7f077c437640 1 -- 172.21.15.18:0/2666904333 wait complete. 2024-09-19T08:44:30.544 INFO:teuthology.orchestra.run.smithi018.stdout:133143986239 2024-09-19T08:44:30.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T08:44:30.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 -- 172.21.15.18:0/2844715452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0101de0 msgr2=0x7f6ae01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 --2- 172.21.15.18:0/2844715452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0101de0 0x7f6ae01021c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009900 tx=0x7f6ad002a410 comp rx=0 tx=0).stop 2024-09-19T08:44:30.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 -- 172.21.15.18:0/2844715452 shutdown_connections 2024-09-19T08:44:30.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 --2- 172.21.15.18:0/2844715452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae0106f10 0x7f6ae010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 --2- 172.21.15.18:0/2844715452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ae0102790 0x7f6ae01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 --2- 172.21.15.18:0/2844715452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0101de0 0x7f6ae01021c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 -- 172.21.15.18:0/2844715452 >> 172.21.15.18:0/2844715452 conn(0x7f6ae00fd8c0 msgr2=0x7f6ae00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 -- 172.21.15.18:0/2844715452 shutdown_connections 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 -- 172.21.15.18:0/2844715452 wait complete. 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.701+0000 7f6ae58df640 1 Processor -- start 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 -- start start 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ae0101de0 0x7f6ae01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae0102790 0x7f6ae0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0106f10 0x7f6ae019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0111e40 con 0x7f6ae0106f10 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0111cc0 con 0x7f6ae0102790 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ae58df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0111fc0 con 0x7f6ae0101de0 2024-09-19T08:44:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0106f10 0x7f6ae019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0106f10 0x7f6ae019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42266/0 (socket says 172.21.15.18:42266) 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ae0101de0 0x7f6ae01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 -- 172.21.15.18:0/274915814 learned_addr learned my addr 172.21.15.18:0/274915814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6ade7fc640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae0102790 0x7f6ae0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 -- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ae0101de0 msgr2=0x7f6ae01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ae0101de0 0x7f6ae01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 -- 172.21.15.18:0/274915814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae0102790 msgr2=0x7f6ae0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae0102790 0x7f6ae0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 -- 172.21.15.18:0/274915814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae019d3a0 con 0x7f6ae0106f10 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.702+0000 7f6adf7fe640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0106f10 0x7f6ae019ccc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800eaa0 tx=0x7f6ad800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.703+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004d20 con 0x7f6ae0106f10 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.703+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae019d690 con 0x7f6ae0106f10 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.703+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ad8005020 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.703+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80116b0 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.703+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae01a4f70 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.704+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ae0062980 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.705+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ad80051d0 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6ae48dd640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6acc0a32d0 0x7f6acc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6adeffd640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6acc0a32d0 0x7f6acc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f6ad80d0390 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6ae48dd640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] conn(0x7f6acc0ae4a0 0x7f6acc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 --> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ad8014ec0 con 0x7f6acc0ae4a0 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6ad80d07e0 con 0x7f6ae0106f10 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6adeffd640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6acc0a32d0 0x7f6acc0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0031440 tx=0x7f6ad0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.706+0000 7f6ade7fc640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] conn(0x7f6acc0ae4a0 0x7f6acc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.707+0000 7f6ade7fc640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] conn(0x7f6acc0ae4a0 0x7f6acc0b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.708+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== osd.2 v2:172.21.15.162:6800/1472595210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ad8014ec0 con 0x7f6acc0ae4a0 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.722+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 --> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ae0062e00 con 0x7f6acc0ae4a0 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.722+0000 7f6ae48dd640 1 -- 172.21.15.18:0/274915814 <== osd.2 v2:172.21.15.162:6800/1472595210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ae0062e00 con 0x7f6acc0ae4a0 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] conn(0x7f6acc0ae4a0 msgr2=0x7f6acc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] conn(0x7f6acc0ae4a0 0x7f6acc0b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6acc0a32d0 msgr2=0x7f6acc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6acc0a32d0 0x7f6acc0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0031440 tx=0x7f6ad0005b50 comp rx=0 tx=0).stop 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0106f10 msgr2=0x7f6ae019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 --2- 172.21.15.18:0/274915814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae0106f10 0x7f6ae019ccc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800eaa0 tx=0x7f6ad800eea0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6adf7fe640 1 -- 172.21.15.18:0/274915814 reap_dead start 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 shutdown_connections 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 >> 172.21.15.18:0/274915814 conn(0x7f6ae00fd8c0 msgr2=0x7f6ae00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 shutdown_connections 2024-09-19T08:44:30.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:28.723+0000 7f6ae58df640 1 -- 172.21.15.18:0/274915814 wait complete. 2024-09-19T08:44:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 -- 172.21.15.18:0/2076258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940102790 msgr2=0x7fa9401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 --2- 172.21.15.18:0/2076258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940102790 0x7fa9401067e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa930009900 tx=0x7fa93002a410 comp rx=0 tx=0).stop 2024-09-19T08:44:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 -- 172.21.15.18:0/2076258028 shutdown_connections 2024-09-19T08:44:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 --2- 172.21.15.18:0/2076258028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940106f10 0x7fa94010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 --2- 172.21.15.18:0/2076258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940102790 0x7fa9401067e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 --2- 172.21.15.18:0/2076258028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa940101de0 0x7fa9401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 -- 172.21.15.18:0/2076258028 >> 172.21.15.18:0/2076258028 conn(0x7fa9400fd8c0 msgr2=0x7fa9400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 -- 172.21.15.18:0/2076258028 shutdown_connections 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.909+0000 7fa94741d640 1 -- 172.21.15.18:0/2076258028 wait complete. 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 Processor -- start 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 -- start start 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 0x7fa940198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa940102790 0x7fa940198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940106f10 0x7fa94019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa940111e60 con 0x7fa940101de0 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa940111ce0 con 0x7fa940102790 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa94741d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa940111fe0 con 0x7fa940106f10 2024-09-19T08:44:30.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 0x7fa940198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 0x7fa940198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42230/0 (socket says 172.21.15.18:42230) 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 -- 172.21.15.18:0/4021988824 learned_addr learned my addr 172.21.15.18:0/4021988824 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9449b8640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa940102790 0x7fa940198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9459ba640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940106f10 0x7fa94019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 -- 172.21.15.18:0/4021988824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940106f10 msgr2=0x7fa94019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940106f10 0x7fa94019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 -- 172.21.15.18:0/4021988824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa940102790 msgr2=0x7fa940198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa940102790 0x7fa940198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 -- 172.21.15.18:0/4021988824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94019d3b0 con 0x7fa940101de0 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.910+0000 7fa9451b9640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 0x7fa940198400 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00b4a0 tx=0x7fa93c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.911+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c014070 con 0x7fa940101de0 2024-09-19T08:44:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.911+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa93c010ac0 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.911+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94019d6a0 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.911+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c017c30 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.911+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9401a4f80 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.912+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9401021c0 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.913+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa93c017070 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.914+0000 7fa9367fc640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa92c0a32d0 0x7fa92c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.914+0000 7fa9449b8640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa92c0a32d0 0x7fa92c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.914+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa93c0cf010 con 0x7fa940101de0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.914+0000 7fa9449b8640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa92c0a32d0 0x7fa92c0a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa930031440 tx=0x7fa930005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:30.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:30.918+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa93c09b330 con 0x7fa940101de0 2024-09-19T08:44:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.094+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa94010a150 con 0x7fa940101de0 2024-09-19T08:44:31.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.094+0000 7fa9367fc640 1 -- 172.21.15.18:0/4021988824 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa93c09f630 con 0x7fa940101de0 2024-09-19T08:44:31.094 INFO:teuthology.orchestra.run.smithi018.stdout:317827579933 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa92c0a32d0 msgr2=0x7fa92c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa92c0a32d0 0x7fa92c0a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa930031440 tx=0x7fa930005b50 comp rx=0 tx=0).stop 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 msgr2=0x7fa940198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 0x7fa940198400 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00b4a0 tx=0x7fa93c00b960 comp rx=0 tx=0).stop 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 shutdown_connections 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa92c0a32d0 0x7fa92c0a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940106f10 0x7fa94019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa940102790 0x7fa940198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 --2- 172.21.15.18:0/4021988824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa940101de0 0x7fa940198400 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 >> 172.21.15.18:0/4021988824 conn(0x7fa9400fd8c0 msgr2=0x7fa9400fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:31.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 shutdown_connections 2024-09-19T08:44:31.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:31.096+0000 7fa94741d640 1 -- 172.21.15.18:0/4021988824 wait complete. 2024-09-19T08:44:31.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:31 smithi018 ceph-mon[30956]: pgmap v324: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 967 B/s rd, 1 op/s; 54 B/s, 0 objects/s recovering 2024-09-19T08:44:31.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:31 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4021988824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:44:31.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:31 smithi162 ceph-mon[34870]: pgmap v324: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 967 B/s rd, 1 op/s; 54 B/s, 0 objects/s recovering 2024-09-19T08:44:31.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:31 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/4021988824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:44:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:31 smithi150 ceph-mon[34610]: pgmap v324: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 967 B/s rd, 1 op/s; 54 B/s, 0 objects/s recovering 2024-09-19T08:44:31.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:31 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/4021988824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:44:31.899 INFO:teuthology.orchestra.run.smithi018.stdout:77309411400 2024-09-19T08:44:31.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T08:44:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 -- 172.21.15.18:0/4270417229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a4410c170 msgr2=0x7f8a4410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4270417229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a4410c170 0x7f8a4410e610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009ca0 tx=0x7f8a3c02a950 comp rx=0 tx=0).stop 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 -- 172.21.15.18:0/4270417229 shutdown_connections 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4270417229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a4410c170 0x7f8a4410e610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4270417229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a44103660 0x7f8a4410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4270417229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a44102d40 0x7f8a44103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 -- 172.21.15.18:0/4270417229 >> 172.21.15.18:0/4270417229 conn(0x7f8a440fc7a0 msgr2=0x7f8a440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 -- 172.21.15.18:0/4270417229 shutdown_connections 2024-09-19T08:44:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.412+0000 7f8a489b7640 1 -- 172.21.15.18:0/4270417229 wait complete. 2024-09-19T08:44:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 Processor -- start 2024-09-19T08:44:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 -- start start 2024-09-19T08:44:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a44102d40 0x7f8a4419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a44103660 0x7f8a4419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4410c170 0x7f8a4419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44111e20 con 0x7f8a44102d40 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44111ca0 con 0x7f8a44103660 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a489b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44111fa0 con 0x7f8a4410c170 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a4259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a44102d40 0x7f8a4419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a4259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a44102d40 0x7f8a4419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42240/0 (socket says 172.21.15.18:42240) 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a4259c640 1 -- 172.21.15.18:0/4110514458 learned_addr learned my addr 172.21.15.18:0/4110514458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a41d9b640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a44103660 0x7f8a4419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.413+0000 7f8a42d9d640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4410c170 0x7f8a4419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a4259c640 1 -- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4410c170 msgr2=0x7f8a4419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a4259c640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4410c170 0x7f8a4419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a4259c640 1 -- 172.21.15.18:0/4110514458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a44103660 msgr2=0x7f8a4419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a4259c640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a44103660 0x7f8a4419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a4259c640 1 -- 172.21.15.18:0/4110514458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4419f4f0 con 0x7f8a44102d40 2024-09-19T08:44:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a4259c640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a44102d40 0x7f8a4419a5e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d950 tx=0x7f8a3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:32.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34017070 con 0x7f8a44102d40 2024-09-19T08:44:32.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a34009c30 con 0x7f8a44102d40 2024-09-19T08:44:32.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4419f7e0 con 0x7f8a44102d40 2024-09-19T08:44:32.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400f620 con 0x7f8a44102d40 2024-09-19T08:44:32.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.414+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441a70c0 con 0x7f8a44102d40 2024-09-19T08:44:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.415+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a44102560 con 0x7f8a44102d40 2024-09-19T08:44:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.417+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8a340109a0 con 0x7f8a44102d40 2024-09-19T08:44:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.417+0000 7f8a337fe640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8a2c0a33d0 0x7f8a2c0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a41d9b640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8a2c0a33d0 0x7f8a2c0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f8a340cf990 con 0x7f8a44102d40 2024-09-19T08:44:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a337fe640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] conn(0x7f8a2c0ae5a0 0x7f8a2c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 --> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a34004470 con 0x7f8a2c0ae5a0 2024-09-19T08:44:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f8a340d6050 con 0x7f8a44102d40 2024-09-19T08:44:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a41d9b640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8a2c0a33d0 0x7f8a2c0a5890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8a440fec70 tx=0x7f8a38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.418+0000 7f8a42d9d640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] conn(0x7f8a2c0ae5a0 0x7f8a2c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.419+0000 7f8a42d9d640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] conn(0x7f8a2c0ae5a0 0x7f8a2c0b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.420+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== osd.8 v2:172.21.15.162:6816/2409536118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a34004470 con 0x7f8a2c0ae5a0 2024-09-19T08:44:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.434+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 --> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a4406b070 con 0x7f8a2c0ae5a0 2024-09-19T08:44:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a337fe640 1 -- 172.21.15.18:0/4110514458 <== osd.8 v2:172.21.15.162:6816/2409536118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8a4406b070 con 0x7f8a2c0ae5a0 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] conn(0x7f8a2c0ae5a0 msgr2=0x7f8a2c0b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] conn(0x7f8a2c0ae5a0 0x7f8a2c0b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8a2c0a33d0 msgr2=0x7f8a2c0a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8a2c0a33d0 0x7f8a2c0a5890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8a440fec70 tx=0x7f8a38005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a44102d40 msgr2=0x7f8a4419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 --2- 172.21.15.18:0/4110514458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a44102d40 0x7f8a4419a5e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d950 tx=0x7f8a3400de10 comp rx=0 tx=0).stop 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a42d9d640 1 -- 172.21.15.18:0/4110514458 reap_dead start 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 shutdown_connections 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 >> 172.21.15.18:0/4110514458 conn(0x7f8a440fc7a0 msgr2=0x7f8a44101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 shutdown_connections 2024-09-19T08:44:32.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:32.435+0000 7f8a489b7640 1 -- 172.21.15.18:0/4110514458 wait complete. 2024-09-19T08:44:32.585 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972389 got 266287972390 for osd.9 2024-09-19T08:44:32.585 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:33.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:33 smithi162 ceph-mon[34870]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T08:44:33.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:33 smithi018 ceph-mon[30956]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T08:44:33.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:33 smithi150 ceph-mon[34610]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T08:44:33.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579932 got 317827579933 for osd.11 2024-09-19T08:44:33.884 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:34.214 INFO:teuthology.orchestra.run.smithi018.stdout:231928234028 2024-09-19T08:44:34.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T08:44:34.467 INFO:teuthology.orchestra.run.smithi018.stdout:55834574927 2024-09-19T08:44:34.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T08:44:35.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 -- 172.21.15.18:0/4224266995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0106f10 msgr2=0x7fd4a010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 --2- 172.21.15.18:0/4224266995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0106f10 0x7fd4a010ea90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd498009ca0 tx=0x7fd49802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 -- 172.21.15.18:0/4224266995 shutdown_connections 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 --2- 172.21.15.18:0/4224266995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0106f10 0x7fd4a010ea90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 --2- 172.21.15.18:0/4224266995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4a0102790 0x7fd4a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 --2- 172.21.15.18:0/4224266995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4a0101de0 0x7fd4a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 -- 172.21.15.18:0/4224266995 >> 172.21.15.18:0/4224266995 conn(0x7fd4a00fd8c0 msgr2=0x7fd4a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 -- 172.21.15.18:0/4224266995 shutdown_connections 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.022+0000 7fd4a5691640 1 -- 172.21.15.18:0/4224266995 wait complete. 2024-09-19T08:44:35.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 Processor -- start 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 -- start start 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0101de0 0x7fd4a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4a0102790 0x7fd4a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4a0106f10 0x7fd4a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a0111e70 con 0x7fd4a0101de0 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a0111cf0 con 0x7fd4a0102790 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd4a5691640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a0111ff0 con 0x7fd4a0106f10 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0101de0 0x7fd4a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0101de0 0x7fd4a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42252/0 (socket says 172.21.15.18:42252) 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 -- 172.21.15.18:0/3488262494 learned_addr learned my addr 172.21.15.18:0/3488262494 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd497fff640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4a0102790 0x7fd4a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49f7fe640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4a0106f10 0x7fd4a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 -- 172.21.15.18:0/3488262494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4a0106f10 msgr2=0x7fd4a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4a0106f10 0x7fd4a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 -- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4a0102790 msgr2=0x7fd4a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4a0102790 0x7fd4a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.023+0000 7fd49effd640 1 -- 172.21.15.18:0/3488262494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a01a67d0 con 0x7fd4a0101de0 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.024+0000 7fd49effd640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0101de0 0x7fd4a00744f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd49000d950 tx=0x7fd49000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.024+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490017070 con 0x7fd4a0101de0 2024-09-19T08:44:35.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.024+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd490009c30 con 0x7fd4a0101de0 2024-09-19T08:44:35.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.024+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a01a6ac0 con 0x7fd4a0101de0 2024-09-19T08:44:35.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.024+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49000f620 con 0x7fd4a0101de0 2024-09-19T08:44:35.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.024+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a01a7000 con 0x7fd4a0101de0 2024-09-19T08:44:35.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.025+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4a0062880 con 0x7fd4a0101de0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.026+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd4900109a0 con 0x7fd4a0101de0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.027+0000 7fd49cff9640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd48c0a32d0 0x7fd48c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.027+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fd4900cfd80 con 0x7fd4a0101de0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.027+0000 7fd497fff640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd48c0a32d0 0x7fd48c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.027+0000 7fd49cff9640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] conn(0x7fd48c0ae4a0 0x7fd48c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.027+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 --> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd49001ce50 con 0x7fd48c0ae4a0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.027+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fd4900d01d0 con 0x7fd4a0101de0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.028+0000 7fd497fff640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd48c0a32d0 0x7fd48c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0075f80 tx=0x7fd488005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.028+0000 7fd49f7fe640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] conn(0x7fd48c0ae4a0 0x7fd48c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.028+0000 7fd49f7fe640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] conn(0x7fd48c0ae4a0 0x7fd48c0b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.029+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== osd.10 v2:172.21.15.150:6824/1892479254 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd49001ce50 con 0x7fd48c0ae4a0 2024-09-19T08:44:35.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 --> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4a0062d00 con 0x7fd48c0ae4a0 2024-09-19T08:44:35.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd49cff9640 1 -- 172.21.15.18:0/3488262494 <== osd.10 v2:172.21.15.150:6824/1892479254 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd4a0062d00 con 0x7fd48c0ae4a0 2024-09-19T08:44:35.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] conn(0x7fd48c0ae4a0 msgr2=0x7fd48c0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] conn(0x7fd48c0ae4a0 0x7fd48c0b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd48c0a32d0 msgr2=0x7fd48c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fd48c0a32d0 0x7fd48c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0075f80 tx=0x7fd488005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0101de0 msgr2=0x7fd4a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd4a5691640 1 --2- 172.21.15.18:0/3488262494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4a0101de0 0x7fd4a00744f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd49000d950 tx=0x7fd49000de10 comp rx=0 tx=0).stop 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.043+0000 7fd49f7fe640 1 -- 172.21.15.18:0/3488262494 reap_dead start 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.044+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 shutdown_connections 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.044+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 >> 172.21.15.18:0/3488262494 conn(0x7fd4a00fd8c0 msgr2=0x7fd4a00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.044+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 shutdown_connections 2024-09-19T08:44:35.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.044+0000 7fd4a5691640 1 -- 172.21.15.18:0/3488262494 wait complete. 2024-09-19T08:44:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 -- 172.21.15.18:0/2086345138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e01082a0 msgr2=0x7f90e010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 --2- 172.21.15.18:0/2086345138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e01082a0 0x7f90e010ec40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009cd0 tx=0x7f90d802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 -- 172.21.15.18:0/2086345138 shutdown_connections 2024-09-19T08:44:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 --2- 172.21.15.18:0/2086345138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e01082a0 0x7f90e010ec40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 --2- 172.21.15.18:0/2086345138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e01036e0 0x7f90e0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 --2- 172.21.15.18:0/2086345138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e0102d30 0x7f90e0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 -- 172.21.15.18:0/2086345138 >> 172.21.15.18:0/2086345138 conn(0x7f90e00fc7d0 msgr2=0x7f90e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 -- 172.21.15.18:0/2086345138 shutdown_connections 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.338+0000 7f90e86ff640 1 -- 172.21.15.18:0/2086345138 wait complete. 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 Processor -- start 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 -- start start 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e0102d30 0x7f90e0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e01036e0 0x7f90e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e01082a0 0x7f90e019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0111f50 con 0x7f90e0102d30 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0111dd0 con 0x7f90e01082a0 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e86ff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90e01120d0 con 0x7f90e01036e0 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e0102d30 0x7f90e0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e0102d30 0x7f90e0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42280/0 (socket says 172.21.15.18:42280) 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 -- 172.21.15.18:0/1497484194 learned_addr learned my addr 172.21.15.18:0/1497484194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e5c9a640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e01036e0 0x7f90e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e6c9c640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e01082a0 0x7f90e019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 -- 172.21.15.18:0/1497484194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e01036e0 msgr2=0x7f90e01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90e01036e0 0x7f90e01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 -- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e01082a0 msgr2=0x7f90e019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e01082a0 0x7f90e019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e649b640 1 -- 172.21.15.18:0/1497484194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e019d440 con 0x7f90e0102d30 2024-09-19T08:44:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.339+0000 7f90e6c9c640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90e01082a0 0x7f90e019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.340+0000 7f90e649b640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e0102d30 0x7f90e0198490 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00d950 tx=0x7f90dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.340+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc017030 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.340+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90dc004020 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.340+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e019d730 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.340+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0047a0 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.340+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e01a5010 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.341+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90e0062940 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.342+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f90dc0041d0 con 0x7f90e0102d30 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90d77fe640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f90cc0a32d0 0x7f90cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f90dc0cffa0 con 0x7f90e0102d30 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90e5c9a640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f90cc0a32d0 0x7f90cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90d77fe640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] conn(0x7f90cc0ae4a0 0x7f90cc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 --> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90dc0056a0 con 0x7f90cc0ae4a0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f90dc0d03f0 con 0x7f90e0102d30 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90e5c9a640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f90cc0a32d0 0x7f90cc0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90e00fee60 tx=0x7f90d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.343+0000 7f90e6c9c640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] conn(0x7f90cc0ae4a0 0x7f90cc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.344+0000 7f90e6c9c640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] conn(0x7f90cc0ae4a0 0x7f90cc0b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.345+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== osd.7 v2:172.21.15.150:6816/2823141522 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90dc0056a0 con 0x7f90cc0ae4a0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.358+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 --> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90e0062dc0 con 0x7f90cc0ae4a0 2024-09-19T08:44:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90d77fe640 1 -- 172.21.15.18:0/1497484194 <== osd.7 v2:172.21.15.150:6816/2823141522 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f90e0062dc0 con 0x7f90cc0ae4a0 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] conn(0x7f90cc0ae4a0 msgr2=0x7f90cc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e86ff640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] conn(0x7f90cc0ae4a0 0x7f90cc0b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f90cc0a32d0 msgr2=0x7f90cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e86ff640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f90cc0a32d0 0x7f90cc0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90e00fee60 tx=0x7f90d000b410 comp rx=0 tx=0).stop 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e0102d30 msgr2=0x7f90e0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e86ff640 1 --2- 172.21.15.18:0/1497484194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90e0102d30 0x7f90e0198490 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00d950 tx=0x7f90dc00de10 comp rx=0 tx=0).stop 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.359+0000 7f90e6c9c640 1 -- 172.21.15.18:0/1497484194 reap_dead start 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.360+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 shutdown_connections 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.360+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 >> 172.21.15.18:0/1497484194 conn(0x7f90e00fc7d0 msgr2=0x7f90e0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.360+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 shutdown_connections 2024-09-19T08:44:35.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:35.360+0000 7f90e86ff640 1 -- 172.21.15.18:0/1497484194 wait complete. 2024-09-19T08:44:35.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:35 smithi162 ceph-mon[34870]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 851 B/s rd, 1 op/s 2024-09-19T08:44:35.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:35 smithi018 ceph-mon[30956]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 851 B/s rd, 1 op/s 2024-09-19T08:44:35.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:35 smithi150 ceph-mon[34610]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 851 B/s rd, 1 op/s 2024-09-19T08:44:36.051 INFO:teuthology.orchestra.run.smithi018.stdout:201863462963 2024-09-19T08:44:36.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T08:44:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:36.726 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:36.727 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:36.727 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:36.758 INFO:teuthology.orchestra.run.smithi018.stdout:287762808867 2024-09-19T08:44:36.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T08:44:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 -- 172.21.15.18:0/1718278691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c8102d30 msgr2=0x7f09c8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 --2- 172.21.15.18:0/1718278691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c8102d30 0x7f09c8103110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009930 tx=0x7f09b802a420 comp rx=0 tx=0).stop 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 -- 172.21.15.18:0/1718278691 shutdown_connections 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 --2- 172.21.15.18:0/1718278691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09c81082a0 0x7f09c810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 --2- 172.21.15.18:0/1718278691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c81036e0 0x7f09c8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 --2- 172.21.15.18:0/1718278691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c8102d30 0x7f09c8103110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 -- 172.21.15.18:0/1718278691 >> 172.21.15.18:0/1718278691 conn(0x7f09c80fc7d0 msgr2=0x7f09c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 -- 172.21.15.18:0/1718278691 shutdown_connections 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.282+0000 7f09cdb20640 1 -- 172.21.15.18:0/1718278691 wait complete. 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 Processor -- start 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 -- start start 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c8102d30 0x7f09c819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 0x7f09c819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09c81082a0 0x7f09c819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8111f50 con 0x7f09c81036e0 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8111dd0 con 0x7f09c81082a0 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.283+0000 7f09cdb20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81120d0 con 0x7f09c8102d30 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 0x7f09c819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 0x7f09c819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42300/0 (socket says 172.21.15.18:42300) 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 -- 172.21.15.18:0/3580067786 learned_addr learned my addr 172.21.15.18:0/3580067786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c77fe640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c8102d30 0x7f09c819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c7fff640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09c81082a0 0x7f09c819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 -- 172.21.15.18:0/3580067786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c8102d30 msgr2=0x7f09c819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c8102d30 0x7f09c819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 -- 172.21.15.18:0/3580067786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09c81082a0 msgr2=0x7f09c819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09c81082a0 0x7f09c819ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 -- 172.21.15.18:0/3580067786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c819f640 con 0x7f09c81036e0 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c77fe640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c8102d30 0x7f09c819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c6ffd640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 0x7f09c819abd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00d950 tx=0x7f09bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc017070 con 0x7f09c81036e0 2024-09-19T08:44:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09bc009c30 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c819f930 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0047a0 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.284+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c81a7210 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.285+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c806a850 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.287+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f09bc004020 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.288+0000 7f09c4ff9640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09b00a32d0 0x7f09b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.288+0000 7f09c77fe640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09b00a32d0 0x7f09b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.288+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f09bc0cff20 con 0x7f09c81036e0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.288+0000 7f09c77fe640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09b00a32d0 0x7f09b00a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f09b8000c00 tx=0x7f09b8009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:37.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.292+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f09bc020020 con 0x7f09c81036e0 2024-09-19T08:44:37.473 INFO:teuthology.orchestra.run.smithi018.stdout:103079215175 2024-09-19T08:44:37.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.473+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f09c81a7440 con 0x7f09c81036e0 2024-09-19T08:44:37.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.473+0000 7f09c4ff9640 1 -- 172.21.15.18:0/3580067786 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f09bc09c720 con 0x7f09c81036e0 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09b00a32d0 msgr2=0x7f09b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09b00a32d0 0x7f09b00a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f09b8000c00 tx=0x7f09b8009610 comp rx=0 tx=0).stop 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 msgr2=0x7f09c819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 0x7f09c819abd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00d950 tx=0x7f09bc00de10 comp rx=0 tx=0).stop 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 shutdown_connections 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09b00a32d0 0x7f09b00a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09c81082a0 0x7f09c819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c81036e0 0x7f09c819abd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 --2- 172.21.15.18:0/3580067786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09c8102d30 0x7f09c819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.475+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 >> 172.21.15.18:0/3580067786 conn(0x7f09c80fc7d0 msgr2=0x7f09c810d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:37.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.476+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 shutdown_connections 2024-09-19T08:44:37.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.476+0000 7f09cdb20640 1 -- 172.21.15.18:0/3580067786 wait complete. 2024-09-19T08:44:37.652 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:37 smithi018 ceph-mon[30956]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:37.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:37 smithi162 ceph-mon[34870]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:37.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:37 smithi150 ceph-mon[34610]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 -- 172.21.15.18:0/2186098242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008102570 msgr2=0x7f40081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 --2- 172.21.15.18:0/2186098242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008102570 0x7f40081029b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009900 tx=0x7f3ff402a480 comp rx=0 tx=0).stop 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 -- 172.21.15.18:0/2186098242 shutdown_connections 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 --2- 172.21.15.18:0/2186098242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4008102ef0 0x7f400810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 --2- 172.21.15.18:0/2186098242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008102570 0x7f40081029b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 --2- 172.21.15.18:0/2186098242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4008100e20 0x7f4008101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 -- 172.21.15.18:0/2186098242 >> 172.21.15.18:0/2186098242 conn(0x7f40080fc7d0 msgr2=0x7f40080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 -- 172.21.15.18:0/2186098242 shutdown_connections 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.990+0000 7f400ead7640 1 -- 172.21.15.18:0/2186098242 wait complete. 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 Processor -- start 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 -- start start 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 0x7f400819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4008102570 0x7f400819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4008102ef0 0x7f400819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4008110ed0 con 0x7f4008100e20 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4008110d50 con 0x7f4008102570 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400ead7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4008111050 con 0x7f4008102ef0 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 0x7f400819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 0x7f400819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42306/0 (socket says 172.21.15.18:42306) 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 -- 172.21.15.18:0/4166875265 learned_addr learned my addr 172.21.15.18:0/4166875265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f4007fff640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4008102570 0x7f400819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400d074640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4008102ef0 0x7f400819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 -- 172.21.15.18:0/4166875265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4008102ef0 msgr2=0x7f400819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4008102ef0 0x7f400819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 -- 172.21.15.18:0/4166875265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4008102570 msgr2=0x7f400819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4008102570 0x7f400819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.991+0000 7f400c873640 1 -- 172.21.15.18:0/4166875265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400819f690 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.992+0000 7f400c873640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 0x7f400819a6e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00b4a0 tx=0x7f3ffc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.992+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc014070 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.992+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ffc010ac0 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.992+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400819f980 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.992+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc017c30 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.992+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40081a7260 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.993+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4008101200 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.994+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3ffc017070 con 0x7f4008100e20 2024-09-19T08:44:37.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.995+0000 7f4005ffb640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3ff80a3350 0x7f3ff80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:38.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.995+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f3ffc0cf330 con 0x7f4008100e20 2024-09-19T08:44:38.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.995+0000 7f4007fff640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3ff80a3350 0x7f3ff80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:38.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.995+0000 7f4007fff640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3ff80a3350 0x7f3ff80a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009230 tx=0x7f3ff40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:38.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:37.999+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ffc09bca0 con 0x7f4008100e20 2024-09-19T08:44:38.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.176+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f40081a74f0 con 0x7f4008100e20 2024-09-19T08:44:38.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.177+0000 7f4005ffb640 1 -- 172.21.15.18:0/4166875265 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3ffc09b5a0 con 0x7f4008100e20 2024-09-19T08:44:38.176 INFO:teuthology.orchestra.run.smithi018.stdout:154618822717 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3ff80a3350 msgr2=0x7f3ff80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3ff80a3350 0x7f3ff80a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009230 tx=0x7f3ff40058d0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 msgr2=0x7f400819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 0x7f400819a6e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00b4a0 tx=0x7f3ffc00b960 comp rx=0 tx=0).stop 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 shutdown_connections 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f3ff80a3350 0x7f3ff80a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4008102ef0 0x7f400819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4008102570 0x7f400819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 --2- 172.21.15.18:0/4166875265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4008100e20 0x7f400819a6e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 >> 172.21.15.18:0/4166875265 conn(0x7f40080fc7d0 msgr2=0x7f400806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 shutdown_connections 2024-09-19T08:44:38.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.179+0000 7f400ead7640 1 -- 172.21.15.18:0/4166875265 wait complete. 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 -- 172.21.15.18:0/687795554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d81082a0 msgr2=0x7f03d810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 --2- 172.21.15.18:0/687795554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d81082a0 0x7f03d810ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009cd0 tx=0x7f03d002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 -- 172.21.15.18:0/687795554 shutdown_connections 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 --2- 172.21.15.18:0/687795554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d81082a0 0x7f03d810ec40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 --2- 172.21.15.18:0/687795554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d81036e0 0x7f03d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 --2- 172.21.15.18:0/687795554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d8102d30 0x7f03d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 -- 172.21.15.18:0/687795554 >> 172.21.15.18:0/687795554 conn(0x7f03d80fc7d0 msgr2=0x7f03d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 -- 172.21.15.18:0/687795554 shutdown_connections 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 -- 172.21.15.18:0/687795554 wait complete. 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.193+0000 7f03de24f640 1 Processor -- start 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 -- start start 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 0x7f03d8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d81036e0 0x7f03d8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d81082a0 0x7f03d8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8111f50 con 0x7f03d8102d30 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8111dd0 con 0x7f03d81036e0 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03de24f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03d81120d0 con 0x7f03d81082a0 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 0x7f03d8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 0x7f03d8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42336/0 (socket says 172.21.15.18:42336) 2024-09-19T08:44:38.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 -- 172.21.15.18:0/3497022839 learned_addr learned my addr 172.21.15.18:0/3497022839 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d7fff640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d81082a0 0x7f03d8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d6ffd640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d81036e0 0x7f03d8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 -- 172.21.15.18:0/3497022839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d81082a0 msgr2=0x7f03d8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d81082a0 0x7f03d8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 -- 172.21.15.18:0/3497022839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d81036e0 msgr2=0x7f03d8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d81036e0 0x7f03d8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.194+0000 7f03d77fe640 1 -- 172.21.15.18:0/3497022839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d81a6950 con 0x7f03d8102d30 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.195+0000 7f03d77fe640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 0x7f03d8100990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d950 tx=0x7f03c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.195+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8017070 con 0x7f03d8102d30 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.195+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d81a6c40 con 0x7f03d8102d30 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.195+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03c8009c30 con 0x7f03d8102d30 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.195+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c800f620 con 0x7f03d8102d30 2024-09-19T08:44:38.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.195+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d81a7180 con 0x7f03d8102d30 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.197+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d8103110 con 0x7f03d8102d30 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.197+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f03c80109a0 con 0x7f03d8102d30 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.198+0000 7f03d4ff9640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03c00a32d0 0x7f03c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.198+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f03c80cfa40 con 0x7f03d8102d30 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.198+0000 7f03d6ffd640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03c00a32d0 0x7f03c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.199+0000 7f03d6ffd640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03c00a32d0 0x7f03c00a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03cc005fd0 tx=0x7f03cc00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:38.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.203+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03c8009de0 con 0x7f03d8102d30 2024-09-19T08:44:38.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.383+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f03d810a2b0 con 0x7f03d8102d30 2024-09-19T08:44:38.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.384+0000 7f03d4ff9640 1 -- 172.21.15.18:0/3497022839 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f03c809c2a0 con 0x7f03d8102d30 2024-09-19T08:44:38.383 INFO:teuthology.orchestra.run.smithi018.stdout:184683593783 2024-09-19T08:44:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03c00a32d0 msgr2=0x7f03c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03c00a32d0 0x7f03c00a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03cc005fd0 tx=0x7f03cc00b510 comp rx=0 tx=0).stop 2024-09-19T08:44:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 msgr2=0x7f03d8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 0x7f03d8100990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d950 tx=0x7f03c800de10 comp rx=0 tx=0).stop 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 shutdown_connections 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f03c00a32d0 0x7f03c00a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03d81082a0 0x7f03d8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03d81036e0 0x7f03d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 --2- 172.21.15.18:0/3497022839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03d8102d30 0x7f03d8100990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 >> 172.21.15.18:0/3497022839 conn(0x7f03d80fc7d0 msgr2=0x7f03d8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 shutdown_connections 2024-09-19T08:44:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:38.386+0000 7f03de24f640 1 -- 172.21.15.18:0/3497022839 wait complete. 2024-09-19T08:44:38.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:38 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3580067786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:44:38.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:38 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4166875265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:44:38.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:38 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3580067786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:44:38.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:38 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/4166875265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:44:38.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:38 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3580067786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:44:38.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:38 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/4166875265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:44:39.104 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593780 got 184683593783 for osd.6 2024-09-19T08:44:39.105 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:39.524 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:39.531 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822714 got 154618822717 for osd.5 2024-09-19T08:44:39.531 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:39.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:39 smithi018 ceph-mon[30956]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:39.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:39 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3497022839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:44:39.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:39 smithi162 ceph-mon[34870]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:39.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:39 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3497022839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:44:39.711 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:39.712 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:39.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:39 smithi150 ceph-mon[34610]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:39.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:39 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3497022839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:44:40.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215173 got 103079215175 for osd.3 2024-09-19T08:44:40.442 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 -- 172.21.15.18:0/1371821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 msgr2=0x7fcb6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1371821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c101200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009900 tx=0x7fcb5c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 -- 172.21.15.18:0/1371821484 shutdown_connections 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1371821484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 0x7fcb6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1371821484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb6c102570 0x7fcb6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1371821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c101200 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 -- 172.21.15.18:0/1371821484 >> 172.21.15.18:0/1371821484 conn(0x7fcb6c0fc7d0 msgr2=0x7fcb6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 -- 172.21.15.18:0/1371821484 shutdown_connections 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.949+0000 7fcb738ce640 1 -- 172.21.15.18:0/1371821484 wait complete. 2024-09-19T08:44:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 Processor -- start 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 -- start start 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb6c102570 0x7fcb6c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 0x7fcb6c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c111f50 con 0x7fcb6c100e20 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c111dd0 con 0x7fcb6c102570 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb738ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1120d0 con 0x7fcb6c102ef0 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb7166a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb7166a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45120/0 (socket says 172.21.15.18:45120) 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.950+0000 7fcb7166a640 1 -- 172.21.15.18:0/1934191232 learned_addr learned my addr 172.21.15.18:0/1934191232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb70e69640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb6c102570 0x7fcb6c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb71e6b640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 0x7fcb6c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb7166a640 1 -- 172.21.15.18:0/1934191232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 msgr2=0x7fcb6c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb7166a640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 0x7fcb6c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb7166a640 1 -- 172.21.15.18:0/1934191232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb6c102570 msgr2=0x7fcb6c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb7166a640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb6c102570 0x7fcb6c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb7166a640 1 -- 172.21.15.18:0/1934191232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c19d3c0 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb71e6b640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 0x7fcb6c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb7166a640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c198410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c006010 tx=0x7fcb5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c03f030 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb5c003cb0 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c19d650 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c035070 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.951+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1a4f90 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.952+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c1021b0 con 0x7fcb6c100e20 2024-09-19T08:44:40.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.954+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcb5c042030 con 0x7fcb6c100e20 2024-09-19T08:44:40.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.954+0000 7fcb6a7fc640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcb540a3350 0x7fcb540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.954+0000 7fcb70e69640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcb540a3350 0x7fcb540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.954+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fcb5c0f0510 con 0x7fcb6c100e20 2024-09-19T08:44:40.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.955+0000 7fcb70e69640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcb540a3350 0x7fcb540a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0fffb0 tx=0x7fcb6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:40.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:40.957+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb5c0bcd70 con 0x7fcb6c100e20 2024-09-19T08:44:41.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.135+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcb6c101200 con 0x7fcb6c100e20 2024-09-19T08:44:41.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.135+0000 7fcb6a7fc640 1 -- 172.21.15.18:0/1934191232 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb6c101200 con 0x7fcb6c100e20 2024-09-19T08:44:41.135 INFO:teuthology.orchestra.run.smithi018.stdout:34359738454 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcb540a3350 msgr2=0x7fcb540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcb540a3350 0x7fcb540a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0fffb0 tx=0x7fcb6000b390 comp rx=0 tx=0).stop 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 msgr2=0x7fcb6c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c198410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c006010 tx=0x7fcb5c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 shutdown_connections 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fcb540a3350 0x7fcb540a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb6c102ef0 0x7fcb6c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb6c102570 0x7fcb6c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 --2- 172.21.15.18:0/1934191232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c100e20 0x7fcb6c198410 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 >> 172.21.15.18:0/1934191232 conn(0x7fcb6c0fc7d0 msgr2=0x7fcb6c0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 shutdown_connections 2024-09-19T08:44:41.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.137+0000 7fcb738ce640 1 -- 172.21.15.18:0/1934191232 wait complete. 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 -- 172.21.15.18:0/3994613438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 msgr2=0x7fe7381067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 --2- 172.21.15.18:0/3994613438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe7381067f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe728009900 tx=0x7fe72802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 -- 172.21.15.18:0/3994613438 shutdown_connections 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 --2- 172.21.15.18:0/3994613438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 0x7fe73810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 --2- 172.21.15.18:0/3994613438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe7381067f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 --2- 172.21.15.18:0/3994613438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 0x7fe7381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 -- 172.21.15.18:0/3994613438 >> 172.21.15.18:0/3994613438 conn(0x7fe7380fd8f0 msgr2=0x7fe7380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 -- 172.21.15.18:0/3994613438 shutdown_connections 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 -- 172.21.15.18:0/3994613438 wait complete. 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.202+0000 7fe7405c1640 1 Processor -- start 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 -- start start 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 0x7fe7381983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe738198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 0x7fe73819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe738111e30 con 0x7fe7381027a0 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe738111cb0 con 0x7fe738101df0 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe7405c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe738111fb0 con 0x7fe738106f20 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe738198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe738198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45146/0 (socket says 172.21.15.18:45146) 2024-09-19T08:44:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 -- 172.21.15.18:0/614448493 learned_addr learned my addr 172.21.15.18:0/614448493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73e35d640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 0x7fe7381983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73eb5e640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 0x7fe73819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 -- 172.21.15.18:0/614448493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 msgr2=0x7fe73819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 0x7fe73819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 -- 172.21.15.18:0/614448493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 msgr2=0x7fe7381983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 0x7fe7381983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 -- 172.21.15.18:0/614448493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73819d380 con 0x7fe7381027a0 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73eb5e640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 0x7fe73819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73e35d640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 0x7fe7381983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.203+0000 7fe73db5c640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe738198910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe728005940 tx=0x7fe7280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.204+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72803f030 con 0x7fe7381027a0 2024-09-19T08:44:41.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.204+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe728003cb0 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.204+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73819d610 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.204+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728035070 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.204+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7381a4f50 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.205+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7381032d0 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.206+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe728042030 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.207+0000 7fe72f7fe640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe7240a32d0 0x7fe7240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.207+0000 7fe73e35d640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe7240a32d0 0x7fe7240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.207+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe7280f0910 con 0x7fe7381027a0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.207+0000 7fe73e35d640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe7240a32d0 0x7fe7240a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe734009c20 tx=0x7fe734005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.210+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe7280bd110 con 0x7fe7381027a0 2024-09-19T08:44:41.232 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:41.233 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.400+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe73810a160 con 0x7fe7381027a0 2024-09-19T08:44:41.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:41 smithi018 ceph-mon[30956]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:41.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1934191232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:44:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.400+0000 7fe72f7fe640 1 -- 172.21.15.18:0/614448493 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7280bca10 con 0x7fe7381027a0 2024-09-19T08:44:41.400 INFO:teuthology.orchestra.run.smithi018.stdout:133143986241 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe7240a32d0 msgr2=0x7fe7240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe7240a32d0 0x7fe7240a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe734009c20 tx=0x7fe734005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 msgr2=0x7fe738198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe738198910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe728005940 tx=0x7fe7280042f0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 shutdown_connections 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe7240a32d0 0x7fe7240a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe738106f20 0x7fe73819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7381027a0 0x7fe738198910 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 --2- 172.21.15.18:0/614448493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe738101df0 0x7fe7381983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 >> 172.21.15.18:0/614448493 conn(0x7fe7380fd8f0 msgr2=0x7fe7380fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.402+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 shutdown_connections 2024-09-19T08:44:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:41.403+0000 7fe7405c1640 1 -- 172.21.15.18:0/614448493 wait complete. 2024-09-19T08:44:41.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:41 smithi162 ceph-mon[34870]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:41.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:41 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1934191232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:44:41.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:41 smithi150 ceph-mon[34610]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:41.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:41 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1934191232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:44:42.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/614448493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:44:42.560 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738454 for osd.0 2024-09-19T08:44:42.560 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:42.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/614448493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:44:42.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/614448493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3599900321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144101de0 msgr2=0x7fa1441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3599900321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144101de0 0x7fa1441021c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa140009900 tx=0x7fa14002a410 comp rx=0 tx=0).stop 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3599900321 shutdown_connections 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3599900321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144106f10 0x7fa14410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3599900321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa144102790 0x7fa1441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3599900321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144101de0 0x7fa1441021c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3599900321 >> 172.21.15.18:0/3599900321 conn(0x7fa1440fd8c0 msgr2=0x7fa1440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3599900321 shutdown_connections 2024-09-19T08:44:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.170+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3599900321 wait complete. 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 Processor -- start 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 -- start start 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144101de0 0x7fa144198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa144102790 0x7fa144198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 0x7fa14419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa144111e40 con 0x7fa144106f10 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa144111cc0 con 0x7fa144102790 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14b6c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa144111fc0 con 0x7fa144101de0 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa149c5d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 0x7fa14419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa149c5d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 0x7fa14419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45152/0 (socket says 172.21.15.18:45152) 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa149c5d640 1 -- 172.21.15.18:0/3500336684 learned_addr learned my addr 172.21.15.18:0/3500336684 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa148c5b640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa144102790 0x7fa144198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.171+0000 7fa14945c640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144101de0 0x7fa144198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa149c5d640 1 -- 172.21.15.18:0/3500336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144101de0 msgr2=0x7fa144198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa149c5d640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144101de0 0x7fa144198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa149c5d640 1 -- 172.21.15.18:0/3500336684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa144102790 msgr2=0x7fa144198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa149c5d640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa144102790 0x7fa144198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa149c5d640 1 -- 172.21.15.18:0/3500336684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14419d3b0 con 0x7fa144106f10 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa14945c640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144101de0 0x7fa144198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa149c5d640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 0x7fa14419ccd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00b970 tx=0x7fa13c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c019070 con 0x7fa144106f10 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14419d6a0 con 0x7fa144106f10 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.172+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa13c014440 con 0x7fa144106f10 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.173+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0075d0 con 0x7fa144106f10 2024-09-19T08:44:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.173+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa144074420 con 0x7fa144106f10 2024-09-19T08:44:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.174+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1441021c0 con 0x7fa144106f10 2024-09-19T08:44:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.175+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa13c01c070 con 0x7fa144106f10 2024-09-19T08:44:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.176+0000 7fa13a7fc640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa1300a3350 0x7fa1300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.176+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa13c0cf260 con 0x7fa144106f10 2024-09-19T08:44:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.176+0000 7fa14945c640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa1300a3350 0x7fa1300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.176+0000 7fa14945c640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa1300a3350 0x7fa1300a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa140031440 tx=0x7fa14003c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:43.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.183+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa13c09b580 con 0x7fa144106f10 2024-09-19T08:44:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.361+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa14410a0f0 con 0x7fa144106f10 2024-09-19T08:44:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.361+0000 7fa13a7fc640 1 -- 172.21.15.18:0/3500336684 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa13c09f880 con 0x7fa144106f10 2024-09-19T08:44:43.361 INFO:teuthology.orchestra.run.smithi018.stdout:55834574930 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.363+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa1300a3350 msgr2=0x7fa1300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.363+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa1300a3350 0x7fa1300a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa140031440 tx=0x7fa14003c040 comp rx=0 tx=0).stop 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.363+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 msgr2=0x7fa14419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.363+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 0x7fa14419ccd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00b970 tx=0x7fa13c00be30 comp rx=0 tx=0).stop 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 shutdown_connections 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa1300a3350 0x7fa1300a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa144106f10 0x7fa14419ccd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa144102790 0x7fa144198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 --2- 172.21.15.18:0/3500336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa144101de0 0x7fa144198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 >> 172.21.15.18:0/3500336684 conn(0x7fa1440fd8c0 msgr2=0x7fa1440fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:43.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 shutdown_connections 2024-09-19T08:44:43.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.364+0000 7fa14b6c0640 1 -- 172.21.15.18:0/3500336684 wait complete. 2024-09-19T08:44:43.434 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:43 smithi018 ceph-mon[30956]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:43.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:43 smithi162 ceph-mon[34870]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:43.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:43 smithi150 ceph-mon[34610]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 -- 172.21.15.18:0/741786216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4834102d30 msgr2=0x7f4834103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 --2- 172.21.15.18:0/741786216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4834102d30 0x7f4834103110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4824009930 tx=0x7f482402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 -- 172.21.15.18:0/741786216 shutdown_connections 2024-09-19T08:44:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 --2- 172.21.15.18:0/741786216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48341082a0 0x7f483410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 --2- 172.21.15.18:0/741786216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48341036e0 0x7f4834107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 --2- 172.21.15.18:0/741786216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4834102d30 0x7f4834103110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 -- 172.21.15.18:0/741786216 >> 172.21.15.18:0/741786216 conn(0x7f48340fc7d0 msgr2=0x7f48340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 -- 172.21.15.18:0/741786216 shutdown_connections 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 -- 172.21.15.18:0/741786216 wait complete. 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 Processor -- start 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.802+0000 7f483a641640 1 -- start start 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f483a641640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4834102d30 0x7f4834198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f483a641640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48341036e0 0x7f48341989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f483a641640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 0x7f483419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f483a641640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4834111f50 con 0x7f48341082a0 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f483a641640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4834111dd0 con 0x7f48341036e0 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f483a641640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48341120d0 con 0x7f4834102d30 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 0x7f483419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 0x7f483419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45174/0 (socket says 172.21.15.18:45174) 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 -- 172.21.15.18:0/444276968 learned_addr learned my addr 172.21.15.18:0/444276968 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4833fff640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4834102d30 0x7f4834198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f48337fe640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48341036e0 0x7f48341989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 -- 172.21.15.18:0/444276968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4834102d30 msgr2=0x7f4834198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4834102d30 0x7f4834198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 -- 172.21.15.18:0/444276968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48341036e0 msgr2=0x7f48341989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48341036e0 0x7f48341989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 -- 172.21.15.18:0/444276968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483419d410 con 0x7f48341082a0 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.803+0000 7f4838bde640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 0x7f483419cd30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f482c00cce0 tx=0x7f482c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.804+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c00f450 con 0x7f48341082a0 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.804+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f482c00faa0 con 0x7f48341082a0 2024-09-19T08:44:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.804+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483419d700 con 0x7f48341082a0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.804+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c018b70 con 0x7f48341082a0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.804+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48341a4fe0 con 0x7f48341082a0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.805+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483406a850 con 0x7f48341082a0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.806+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f482c018d10 con 0x7f48341082a0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.807+0000 7f48317fa640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48200a32d0 0x7f48200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.807+0000 7f4833fff640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48200a32d0 0x7f48200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.807+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f482c0d0330 con 0x7f48341082a0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.807+0000 7f4833fff640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48200a32d0 0x7f48200a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4824000c00 tx=0x7f4824032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:43.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.810+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f482c014030 con 0x7f48341082a0 2024-09-19T08:44:43.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.993+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f4834103110 con 0x7f48341082a0 2024-09-19T08:44:43.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.994+0000 7f48317fa640 1 -- 172.21.15.18:0/444276968 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f482c09cc20 con 0x7f48341082a0 2024-09-19T08:44:43.993 INFO:teuthology.orchestra.run.smithi018.stdout:287762808869 2024-09-19T08:44:43.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48200a32d0 msgr2=0x7f48200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48200a32d0 0x7f48200a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4824000c00 tx=0x7f4824032c80 comp rx=0 tx=0).stop 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 msgr2=0x7f483419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 0x7f483419cd30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f482c00cce0 tx=0x7f482c00a620 comp rx=0 tx=0).stop 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 shutdown_connections 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f48200a32d0 0x7f48200a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48341082a0 0x7f483419cd30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48341036e0 0x7f48341989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 --2- 172.21.15.18:0/444276968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4834102d30 0x7f4834198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 >> 172.21.15.18:0/444276968 conn(0x7f48340fc7d0 msgr2=0x7f4834105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 shutdown_connections 2024-09-19T08:44:43.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:43.996+0000 7f483a641640 1 -- 172.21.15.18:0/444276968 wait complete. 2024-09-19T08:44:44.283 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574930 for osd.1 2024-09-19T08:44:44.284 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:44.557 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:44 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3500336684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:44:44.557 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:44 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/444276968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:44:44.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 -- 172.21.15.18:0/1346014486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc101de0 msgr2=0x7f5fbc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/1346014486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc101de0 0x7f5fbc1021c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009900 tx=0x7f5fac02a410 comp rx=0 tx=0).stop 2024-09-19T08:44:44.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 -- 172.21.15.18:0/1346014486 shutdown_connections 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/1346014486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fbc106f10 0x7f5fbc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/1346014486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fbc102790 0x7f5fbc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/1346014486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc101de0 0x7f5fbc1021c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 -- 172.21.15.18:0/1346014486 >> 172.21.15.18:0/1346014486 conn(0x7f5fbc0fd8c0 msgr2=0x7f5fbc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 -- 172.21.15.18:0/1346014486 shutdown_connections 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.558+0000 7f5fc1aab640 1 -- 172.21.15.18:0/1346014486 wait complete. 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 Processor -- start 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 -- start start 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fbc101de0 0x7f5fbc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 0x7f5fbc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fbc106f10 0x7f5fbc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc111e20 con 0x7f5fbc102790 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc111ca0 con 0x7f5fbc101de0 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fc1aab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc111fa0 con 0x7f5fbc106f10 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fbaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 0x7f5fbc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fbaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 0x7f5fbc1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45196/0 (socket says 172.21.15.18:45196) 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fbaffd640 1 -- 172.21.15.18:0/3854169504 learned_addr learned my addr 172.21.15.18:0/3854169504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fbb7fe640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fbc101de0 0x7f5fbc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.559+0000 7f5fbbfff640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fbc106f10 0x7f5fbc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fbaffd640 1 -- 172.21.15.18:0/3854169504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fbc106f10 msgr2=0x7f5fbc19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fbaffd640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fbc106f10 0x7f5fbc19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fbaffd640 1 -- 172.21.15.18:0/3854169504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fbc101de0 msgr2=0x7f5fbc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fbaffd640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fbc101de0 0x7f5fbc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fbaffd640 1 -- 172.21.15.18:0/3854169504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc19d310 con 0x7f5fbc102790 2024-09-19T08:44:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fbaffd640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 0x7f5fbc1988a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000d950 tx=0x7f5fb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0017070 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc19d600 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fb0009c30 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000f620 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.560+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc1a4ee0 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.561+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc1021c0 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.563+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5fb00109a0 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.564+0000 7f5fb8ff9640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5fa40a32d0 0x7f5fa40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.564+0000 7f5fbb7fe640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5fa40a32d0 0x7f5fa40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.564+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f5fb00cfa70 con 0x7f5fbc102790 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.564+0000 7f5fbb7fe640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5fa40a32d0 0x7f5fa40a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5fac031440 tx=0x7f5fac005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.567+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fb0009de0 con 0x7f5fbc102790 2024-09-19T08:44:44.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:44 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3500336684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:44:44.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:44 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/444276968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:44:44.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.746+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5fbc10a150 con 0x7f5fbc102790 2024-09-19T08:44:44.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.746+0000 7f5fb8ff9640 1 -- 172.21.15.18:0/3854169504 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5fb009c270 con 0x7f5fbc102790 2024-09-19T08:44:44.746 INFO:teuthology.orchestra.run.smithi018.stdout:77309411403 2024-09-19T08:44:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5fa40a32d0 msgr2=0x7f5fa40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5fa40a32d0 0x7f5fa40a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5fac031440 tx=0x7f5fac005b50 comp rx=0 tx=0).stop 2024-09-19T08:44:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 msgr2=0x7f5fbc1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 0x7f5fbc1988a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000d950 tx=0x7f5fb000de10 comp rx=0 tx=0).stop 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 shutdown_connections 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5fa40a32d0 0x7f5fa40a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fbc106f10 0x7f5fbc19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fbc102790 0x7f5fbc1988a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 --2- 172.21.15.18:0/3854169504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fbc101de0 0x7f5fbc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 >> 172.21.15.18:0/3854169504 conn(0x7f5fbc0fd8c0 msgr2=0x7f5fbc0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 shutdown_connections 2024-09-19T08:44:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.749+0000 7f5fc1aab640 1 -- 172.21.15.18:0/3854169504 wait complete. 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 -- 172.21.15.18:0/3478894891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 msgr2=0x7f570810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 --2- 172.21.15.18:0/3478894891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f570810bb50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009900 tx=0x7f56f402a480 comp rx=0 tx=0).stop 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 -- 172.21.15.18:0/3478894891 shutdown_connections 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 --2- 172.21.15.18:0/3478894891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570810c170 0x7f570810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 --2- 172.21.15.18:0/3478894891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f570810bb50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 --2- 172.21.15.18:0/3478894891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5708102d40 0x7f5708103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 -- 172.21.15.18:0/3478894891 >> 172.21.15.18:0/3478894891 conn(0x7f57080fc7a0 msgr2=0x7f57080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 -- 172.21.15.18:0/3478894891 shutdown_connections 2024-09-19T08:44:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.805+0000 7f570f234640 1 -- 172.21.15.18:0/3478894891 wait complete. 2024-09-19T08:44:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 Processor -- start 2024-09-19T08:44:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 -- start start 2024-09-19T08:44:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5708102d40 0x7f57081983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f5708198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570810c170 0x7f570819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5708111e20 con 0x7f5708103660 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5708111ca0 con 0x7f570810c170 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f570f234640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5708111fa0 con 0x7f5708102d40 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f5707fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f5708198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.806+0000 7f5707fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f5708198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45206/0 (socket says 172.21.15.18:45206) 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 -- 172.21.15.18:0/1471136811 learned_addr learned my addr 172.21.15.18:0/1471136811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f570cfd0640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5708102d40 0x7f57081983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f570d7d1640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570810c170 0x7f570819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 -- 172.21.15.18:0/1471136811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5708102d40 msgr2=0x7f57081983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5708102d40 0x7f57081983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 -- 172.21.15.18:0/1471136811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570810c170 msgr2=0x7f570819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570810c170 0x7f570819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 -- 172.21.15.18:0/1471136811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570819d370 con 0x7f5708103660 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5707fff640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f5708198900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f56f4005940 tx=0x7f56f40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f403f030 con 0x7f5708103660 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56f40044c0 con 0x7f5708103660 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570819d600 con 0x7f5708103660 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.807+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4035070 con 0x7f5708103660 2024-09-19T08:44:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.808+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57081a4f40 con 0x7f5708103660 2024-09-19T08:44:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.809+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5708103120 con 0x7f5708103660 2024-09-19T08:44:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.810+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f56f4042030 con 0x7f5708103660 2024-09-19T08:44:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.810+0000 7f5705ffb640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f56f80a3350 0x7f56f80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.811+0000 7f570cfd0640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f56f80a3350 0x7f56f80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.811+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f56f40f0300 con 0x7f5708103660 2024-09-19T08:44:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.811+0000 7f570cfd0640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f56f80a3350 0x7f56f80a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009bd0 tx=0x7f56fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.814+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56f40bc510 con 0x7f5708103660 2024-09-19T08:44:44.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:44 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3500336684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:44:44.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:44 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/444276968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:44:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.992+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f5708107210 con 0x7f5708103660 2024-09-19T08:44:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.992+0000 7f5705ffb640 1 -- 172.21.15.18:0/1471136811 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f56f40c0810 con 0x7f5708103660 2024-09-19T08:44:44.992 INFO:teuthology.orchestra.run.smithi018.stdout:231928234030 2024-09-19T08:44:44.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f56f80a3350 msgr2=0x7f56f80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f56f80a3350 0x7f56f80a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009bd0 tx=0x7f56fc005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 msgr2=0x7f5708198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f5708198900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f56f4005940 tx=0x7f56f40040c0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 shutdown_connections 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f56f80a3350 0x7f56f80a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570810c170 0x7f570819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5708103660 0x7f5708198900 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 --2- 172.21.15.18:0/1471136811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5708102d40 0x7f57081983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 >> 172.21.15.18:0/1471136811 conn(0x7f57080fc7a0 msgr2=0x7f57080fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:44.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 shutdown_connections 2024-09-19T08:44:44.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:44.994+0000 7f570f234640 1 -- 172.21.15.18:0/1471136811 wait complete. 2024-09-19T08:44:45.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:45 smithi162 ceph-mon[34870]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:45.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:45 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3854169504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:44:45.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:45 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1471136811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:44:45.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:45 smithi018 ceph-mon[30956]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:45.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:45 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3854169504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:44:45.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:45 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1471136811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:44:45.758 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234028 got 231928234030 for osd.8 2024-09-19T08:44:45.758 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:45 smithi150 ceph-mon[34610]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:45 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3854169504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:44:45.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:45 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1471136811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:44:46.490 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411403 for osd.2 2024-09-19T08:44:46.490 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 -- 172.21.15.18:0/2421865704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918100b20 msgr2=0x7f2918100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 --2- 172.21.15.18:0/2421865704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918100b20 0x7f2918100f00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2908009ca0 tx=0x7f290802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 -- 172.21.15.18:0/2421865704 shutdown_connections 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 --2- 172.21.15.18:0/2421865704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f291810e500 0x7f2918110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 --2- 172.21.15.18:0/2421865704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918101440 0x7f291810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 --2- 172.21.15.18:0/2421865704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918100b20 0x7f2918100f00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 -- 172.21.15.18:0/2421865704 >> 172.21.15.18:0/2421865704 conn(0x7f29180fc7d0 msgr2=0x7f29180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 -- 172.21.15.18:0/2421865704 shutdown_connections 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.647+0000 7f291f907640 1 -- 172.21.15.18:0/2421865704 wait complete. 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 Processor -- start 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 -- start start 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918100b20 0x7f291819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 0x7f291819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f291810e500 0x7f291819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2918114110 con 0x7f2918101440 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2918113f90 con 0x7f2918100b20 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291f907640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2918114290 con 0x7f291810e500 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291cea2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 0x7f291819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291cea2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 0x7f291819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45216/0 (socket says 172.21.15.18:45216) 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291cea2640 1 -- 172.21.15.18:0/584893870 learned_addr learned my addr 172.21.15.18:0/584893870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291dea4640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f291810e500 0x7f291819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.648+0000 7f291d6a3640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918100b20 0x7f291819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291cea2640 1 -- 172.21.15.18:0/584893870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f291810e500 msgr2=0x7f291819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291cea2640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f291810e500 0x7f291819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291cea2640 1 -- 172.21.15.18:0/584893870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918100b20 msgr2=0x7f291819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291cea2640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918100b20 0x7f291819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291cea2640 1 -- 172.21.15.18:0/584893870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291819f5d0 con 0x7f2918101440 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291d6a3640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918100b20 0x7f291819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291cea2640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 0x7f291819ab60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c970 tx=0x7f290c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c007c10 con 0x7f2918101440 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f290c007db0 con 0x7f2918101440 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291819f8c0 con 0x7f2918101440 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c00f870 con 0x7f2918101440 2024-09-19T08:44:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.649+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181a71a0 con 0x7f2918101440 2024-09-19T08:44:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.650+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291806a850 con 0x7f2918101440 2024-09-19T08:44:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.652+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f290c00fa10 con 0x7f2918101440 2024-09-19T08:44:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.652+0000 7f29167fc640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29000a32d0 0x7f29000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.653+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f290c0d0430 con 0x7f2918101440 2024-09-19T08:44:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.653+0000 7f291d6a3640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29000a32d0 0x7f29000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.653+0000 7f291d6a3640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29000a32d0 0x7f29000a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2908000f80 tx=0x7f2908005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:46.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.656+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f290c09cdb0 con 0x7f2918101440 2024-09-19T08:44:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.836+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2918109600 con 0x7f2918101440 2024-09-19T08:44:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.836+0000 7f29167fc640 1 -- 172.21.15.18:0/584893870 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f290c09c6b0 con 0x7f2918101440 2024-09-19T08:44:46.836 INFO:teuthology.orchestra.run.smithi018.stdout:201863462965 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29000a32d0 msgr2=0x7f29000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29000a32d0 0x7f29000a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2908000f80 tx=0x7f2908005ef0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 msgr2=0x7f291819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 0x7f291819ab60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c970 tx=0x7f290c00ce30 comp rx=0 tx=0).stop 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 shutdown_connections 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29000a32d0 0x7f29000a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f291810e500 0x7f291819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2918101440 0x7f291819ab60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 --2- 172.21.15.18:0/584893870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2918100b20 0x7f291819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 >> 172.21.15.18:0/584893870 conn(0x7f29180fc7d0 msgr2=0x7f29180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:46.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 shutdown_connections 2024-09-19T08:44:46.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:46.839+0000 7f291f907640 1 -- 172.21.15.18:0/584893870 wait complete. 2024-09-19T08:44:47.120 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986239 got 133143986241 for osd.4 2024-09-19T08:44:47.120 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:47.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:47 smithi162 ceph-mon[34870]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:47.670 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:47 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/584893870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:44:47.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:47 smithi018 ceph-mon[30956]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:47.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/584893870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:44:47.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:47 smithi150 ceph-mon[34610]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:47.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:47 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/584893870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:44:47.963 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462963 got 201863462965 for osd.7 2024-09-19T08:44:47.963 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:48.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808867 got 287762808869 for osd.10 2024-09-19T08:44:48.468 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:48.468 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:44:48.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:49.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 -- 172.21.15.18:0/2588600678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 msgr2=0x7fba00106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 --2- 172.21.15.18:0/2588600678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba00106840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009930 tx=0x7fb9f402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 -- 172.21.15.18:0/2588600678 shutdown_connections 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 --2- 172.21.15.18:0/2588600678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba00106f50 0x7fba0010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 --2- 172.21.15.18:0/2588600678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba00106840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 --2- 172.21.15.18:0/2588600678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00100350 0x7fba00100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 -- 172.21.15.18:0/2588600678 >> 172.21.15.18:0/2588600678 conn(0x7fba00077210 msgr2=0x7fba000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 -- 172.21.15.18:0/2588600678 shutdown_connections 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.272+0000 7fba0510f640 1 -- 172.21.15.18:0/2588600678 wait complete. 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.273+0000 7fba0510f640 1 Processor -- start 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.273+0000 7fba0510f640 1 -- start start 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fba0510f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00100350 0x7fba001983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fba0510f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba001988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fba0510f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba00106f50 0x7fba0019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fba0510f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fba00111e50 con 0x7fba00100d00 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fba0510f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fba00111cd0 con 0x7fba00106f50 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fba0510f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba00111fd0 con 0x7fba00100350 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba001988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba001988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45232/0 (socket says 172.21.15.18:45232) 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 -- 172.21.15.18:0/1403715221 learned_addr learned my addr 172.21.15.18:0/1403715221 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9ff59e640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba00106f50 0x7fba0019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fed9d640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00100350 0x7fba001983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 -- 172.21.15.18:0/1403715221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00100350 msgr2=0x7fba001983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00100350 0x7fba001983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 -- 172.21.15.18:0/1403715221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba00106f50 msgr2=0x7fba0019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba00106f50 0x7fba0019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 -- 172.21.15.18:0/1403715221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0019d360 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9fe59c640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba001988f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4031440 tx=0x7fb9f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.274+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403f030 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.275+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9f4003aa0 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.275+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0019d5f0 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.275+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4035070 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.275+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba001a4f30 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.276+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba00100730 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.277+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb9f4042030 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.277+0000 7fb9e7fff640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb9e80a3350 0x7fb9e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.278+0000 7fb9fed9d640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb9e80a3350 0x7fb9e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.278+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb9f40f04b0 con 0x7fba00100d00 2024-09-19T08:44:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.278+0000 7fb9fed9d640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb9e80a3350 0x7fb9e80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0005fd0 tx=0x7fb9f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:49.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.282+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9f40bccb0 con 0x7fba00100d00 2024-09-19T08:44:49.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:49 smithi018 ceph-mon[30956]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:44:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.456+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba0010a150 con 0x7fb9e80a3350 2024-09-19T08:44:49.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.465+0000 7fb9e7fff640 1 -- 172.21.15.18:0/1403715221 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340269 (secure 0 0 0) 0x7fba0010a150 con 0x7fb9e80a3350 2024-09-19T08:44:49.468 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:49.470 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb9e80a3350 msgr2=0x7fb9e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb9e80a3350 0x7fb9e80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0005fd0 tx=0x7fb9f0005850 comp rx=0 tx=0).stop 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 msgr2=0x7fba001988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba001988f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4031440 tx=0x7fb9f4004270 comp rx=0 tx=0).stop 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 shutdown_connections 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb9e80a3350 0x7fb9e80a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba00106f50 0x7fba0019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba00100d00 0x7fba001988f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 --2- 172.21.15.18:0/1403715221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00100350 0x7fba001983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 >> 172.21.15.18:0/1403715221 conn(0x7fba00077210 msgr2=0x7fba001053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 shutdown_connections 2024-09-19T08:44:49.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:49.468+0000 7fba0510f640 1 -- 172.21.15.18:0/1403715221 wait complete. 2024-09-19T08:44:49.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:49 smithi162 ceph-mon[34870]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:44:49.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:49 smithi150 ceph-mon[34610]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:44:50.287 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-19T08:44:47.886634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":244,"num_read_kb":233,"num_write":268,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387948,"kb_used_data":13664,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553876,"statfs":{"total":1151940427776,"available":1151543169024,"internally_reserved":0,"allocated":13991936,"data_stored":7896539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":11,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003216"},"pg_stats":[{"pgid":"2.1f","version":"80'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.630917+0000","last_change":"2024-09-19T08:44:19.630917+0000","last_active":"2024-09-19T08:44:19.630917+0000","last_peered":"2024-09-19T08:44:19.630917+0000","last_clean":"2024-09-19T08:44:19.630917+0000","last_became_active":"2024-09-19T08:44:19.627046+0000","last_became_peered":"2024-09-19T08:44:19.627046+0000","last_unstale":"2024-09-19T08:44:19.630917+0000","last_undegraded":"2024-09-19T08:44:19.630917+0000","last_fullsized":"2024-09-19T08:44:19.630917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:51.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306302+0000","last_change":"2024-09-19T08:43:13.510724+0000","last_active":"2024-09-19T08:44:19.306302+0000","last_peered":"2024-09-19T08:44:19.306302+0000","last_clean":"2024-09-19T08:44:19.306302+0000","last_became_active":"2024-09-19T08:43:13.506747+0000","last_became_peered":"2024-09-19T08:43:13.506747+0000","last_unstale":"2024-09-19T08:44:19.306302+0000","last_undegraded":"2024-09-19T08:44:19.306302+0000","last_fullsized":"2024-09-19T08:44:19.306302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:07.182413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306627+0000","last_change":"2024-09-19T08:43:20.550571+0000","last_active":"2024-09-19T08:44:19.306627+0000","last_peered":"2024-09-19T08:44:19.306627+0000","last_clean":"2024-09-19T08:44:19.306627+0000","last_became_active":"2024-09-19T08:43:20.550197+0000","last_became_peered":"2024-09-19T08:43:20.550197+0000","last_unstale":"2024-09-19T08:44:19.306627+0000","last_undegraded":"2024-09-19T08:44:19.306627+0000","last_fullsized":"2024-09-19T08:44:19.306627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:52.442760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306604+0000","last_change":"2024-09-19T08:43:12.059489+0000","last_active":"2024-09-19T08:44:19.306604+0000","last_peered":"2024-09-19T08:44:19.306604+0000","last_clean":"2024-09-19T08:44:19.306604+0000","last_became_active":"2024-09-19T08:43:12.059130+0000","last_became_peered":"2024-09-19T08:43:12.059130+0000","last_unstale":"2024-09-19T08:44:19.306604+0000","last_undegraded":"2024-09-19T08:44:19.306604+0000","last_fullsized":"2024-09-19T08:44:19.306604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:09.336149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304618+0000","last_change":"2024-09-19T08:43:13.511634+0000","last_active":"2024-09-19T08:44:19.304618+0000","last_peered":"2024-09-19T08:44:19.304618+0000","last_clean":"2024-09-19T08:44:19.304618+0000","last_became_active":"2024-09-19T08:43:13.510929+0000","last_became_peered":"2024-09-19T08:43:13.510929+0000","last_unstale":"2024-09-19T08:44:19.304618+0000","last_undegraded":"2024-09-19T08:44:19.304618+0000","last_fullsized":"2024-09-19T08:44:19.304618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:30.793265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442174+0000","last_change":"2024-09-19T08:43:20.542072+0000","last_active":"2024-09-19T08:44:19.442174+0000","last_peered":"2024-09-19T08:44:19.442174+0000","last_clean":"2024-09-19T08:44:19.442174+0000","last_became_active":"2024-09-19T08:43:20.541594+0000","last_became_peered":"2024-09-19T08:43:20.541594+0000","last_unstale":"2024-09-19T08:44:19.442174+0000","last_undegraded":"2024-09-19T08:44:19.442174+0000","last_fullsized":"2024-09-19T08:44:19.442174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:03.635376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303966+0000","last_change":"2024-09-19T08:43:11.459663+0000","last_active":"2024-09-19T08:44:19.303966+0000","last_peered":"2024-09-19T08:44:19.303966+0000","last_clean":"2024-09-19T08:44:19.303966+0000","last_became_active":"2024-09-19T08:43:11.459341+0000","last_became_peered":"2024-09-19T08:43:11.459341+0000","last_unstale":"2024-09-19T08:44:19.303966+0000","last_undegraded":"2024-09-19T08:44:19.303966+0000","last_fullsized":"2024-09-19T08:44:19.303966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:55.861085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626242+0000","last_change":"2024-09-19T08:43:13.511108+0000","last_active":"2024-09-19T08:44:19.626242+0000","last_peered":"2024-09-19T08:44:19.626242+0000","last_clean":"2024-09-19T08:44:19.626242+0000","last_became_active":"2024-09-19T08:43:13.510319+0000","last_became_peered":"2024-09-19T08:43:13.510319+0000","last_unstale":"2024-09-19T08:44:19.626242+0000","last_undegraded":"2024-09-19T08:44:19.626242+0000","last_fullsized":"2024-09-19T08:44:19.626242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.119101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442789+0000","last_change":"2024-09-19T08:43:20.541003+0000","last_active":"2024-09-19T08:44:19.442789+0000","last_peered":"2024-09-19T08:44:19.442789+0000","last_clean":"2024-09-19T08:44:19.442789+0000","last_became_active":"2024-09-19T08:43:20.540597+0000","last_became_peered":"2024-09-19T08:43:20.540597+0000","last_unstale":"2024-09-19T08:44:19.442789+0000","last_undegraded":"2024-09-19T08:44:19.442789+0000","last_fullsized":"2024-09-19T08:44:19.442789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:11.553758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303924+0000","last_change":"2024-09-19T08:43:11.460680+0000","last_active":"2024-09-19T08:44:19.303924+0000","last_peered":"2024-09-19T08:44:19.303924+0000","last_clean":"2024-09-19T08:44:19.303924+0000","last_became_active":"2024-09-19T08:43:11.460335+0000","last_became_peered":"2024-09-19T08:43:11.460335+0000","last_unstale":"2024-09-19T08:44:19.303924+0000","last_undegraded":"2024-09-19T08:44:19.303924+0000","last_fullsized":"2024-09-19T08:44:19.303924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:51.332244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307144+0000","last_change":"2024-09-19T08:43:13.514161+0000","last_active":"2024-09-19T08:44:19.307144+0000","last_peered":"2024-09-19T08:44:19.307144+0000","last_clean":"2024-09-19T08:44:19.307144+0000","last_became_active":"2024-09-19T08:43:13.513674+0000","last_became_peered":"2024-09-19T08:43:13.513674+0000","last_unstale":"2024-09-19T08:44:19.307144+0000","last_undegraded":"2024-09-19T08:44:19.307144+0000","last_fullsized":"2024-09-19T08:44:19.307144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:15.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442411+0000","last_change":"2024-09-19T08:43:20.543781+0000","last_active":"2024-09-19T08:44:19.442411+0000","last_peered":"2024-09-19T08:44:19.442411+0000","last_clean":"2024-09-19T08:44:19.442411+0000","last_became_active":"2024-09-19T08:43:20.543476+0000","last_became_peered":"2024-09-19T08:43:20.543476+0000","last_unstale":"2024-09-19T08:44:19.442411+0000","last_undegraded":"2024-09-19T08:44:19.442411+0000","last_fullsized":"2024-09-19T08:44:19.442411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:27.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303371+0000","last_change":"2024-09-19T08:43:13.512711+0000","last_active":"2024-09-19T08:44:19.303371+0000","last_peered":"2024-09-19T08:44:19.303371+0000","last_clean":"2024-09-19T08:44:19.303371+0000","last_became_active":"2024-09-19T08:43:13.512406+0000","last_became_peered":"2024-09-19T08:43:13.512406+0000","last_unstale":"2024-09-19T08:44:19.303371+0000","last_undegraded":"2024-09-19T08:44:19.303371+0000","last_fullsized":"2024-09-19T08:44:19.303371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:23.765966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.446451+0000","last_change":"2024-09-19T08:44:19.446451+0000","last_active":"2024-09-19T08:44:19.446451+0000","last_peered":"2024-09-19T08:44:19.446451+0000","last_clean":"2024-09-19T08:44:19.446451+0000","last_became_active":"2024-09-19T08:44:19.443811+0000","last_became_peered":"2024-09-19T08:44:19.443811+0000","last_unstale":"2024-09-19T08:44:19.446451+0000","last_undegraded":"2024-09-19T08:44:19.446451+0000","last_fullsized":"2024-09-19T08:44:19.446451+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:38.598731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442826+0000","last_change":"2024-09-19T08:43:20.861786+0000","last_active":"2024-09-19T08:44:19.442826+0000","last_peered":"2024-09-19T08:44:19.442826+0000","last_clean":"2024-09-19T08:44:19.442826+0000","last_became_active":"2024-09-19T08:43:20.861281+0000","last_became_peered":"2024-09-19T08:43:20.861281+0000","last_unstale":"2024-09-19T08:44:19.442826+0000","last_undegraded":"2024-09-19T08:44:19.442826+0000","last_fullsized":"2024-09-19T08:44:19.442826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:47.336930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306410+0000","last_change":"2024-09-19T08:43:13.506879+0000","last_active":"2024-09-19T08:44:19.306410+0000","last_peered":"2024-09-19T08:44:19.306410+0000","last_clean":"2024-09-19T08:44:19.306410+0000","last_became_active":"2024-09-19T08:43:13.506568+0000","last_became_peered":"2024-09-19T08:43:13.506568+0000","last_unstale":"2024-09-19T08:44:19.306410+0000","last_undegraded":"2024-09-19T08:44:19.306410+0000","last_fullsized":"2024-09-19T08:44:19.306410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:50.324234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.312348+0000","last_change":"2024-09-19T08:44:19.309373+0000","last_active":"2024-09-19T08:44:19.312348+0000","last_peered":"2024-09-19T08:44:19.312348+0000","last_clean":"2024-09-19T08:44:19.312348+0000","last_became_active":"2024-09-19T08:44:19.308259+0000","last_became_peered":"2024-09-19T08:44:19.308259+0000","last_unstale":"2024-09-19T08:44:19.312348+0000","last_undegraded":"2024-09-19T08:44:19.312348+0000","last_fullsized":"2024-09-19T08:44:19.312348+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:03.311632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442745+0000","last_change":"2024-09-19T08:43:20.541453+0000","last_active":"2024-09-19T08:44:19.442745+0000","last_peered":"2024-09-19T08:44:19.442745+0000","last_clean":"2024-09-19T08:44:19.442745+0000","last_became_active":"2024-09-19T08:43:20.541014+0000","last_became_peered":"2024-09-19T08:43:20.541014+0000","last_unstale":"2024-09-19T08:44:19.442745+0000","last_undegraded":"2024-09-19T08:44:19.442745+0000","last_fullsized":"2024-09-19T08:44:19.442745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.373513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301543+0000","last_change":"2024-09-19T08:43:13.508404+0000","last_active":"2024-09-19T08:44:19.301543+0000","last_peered":"2024-09-19T08:44:19.301543+0000","last_clean":"2024-09-19T08:44:19.301543+0000","last_became_active":"2024-09-19T08:43:13.508018+0000","last_became_peered":"2024-09-19T08:43:13.508018+0000","last_unstale":"2024-09-19T08:44:19.301543+0000","last_undegraded":"2024-09-19T08:44:19.301543+0000","last_fullsized":"2024-09-19T08:44:19.301543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:43.795388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306529+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:44:19.306529+0000","last_peered":"2024-09-19T08:44:19.306529+0000","last_clean":"2024-09-19T08:44:19.306529+0000","last_became_active":"2024-09-19T08:43:11.463696+0000","last_became_peered":"2024-09-19T08:43:11.463696+0000","last_unstale":"2024-09-19T08:44:19.306529+0000","last_undegraded":"2024-09-19T08:44:19.306529+0000","last_fullsized":"2024-09-19T08:44:19.306529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:18.658727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300684+0000","last_change":"2024-09-19T08:43:20.547619+0000","last_active":"2024-09-19T08:44:19.300684+0000","last_peered":"2024-09-19T08:44:19.300684+0000","last_clean":"2024-09-19T08:44:19.300684+0000","last_became_active":"2024-09-19T08:43:20.547229+0000","last_became_peered":"2024-09-19T08:43:20.547229+0000","last_unstale":"2024-09-19T08:44:19.300684+0000","last_undegraded":"2024-09-19T08:44:19.300684+0000","last_fullsized":"2024-09-19T08:44:19.300684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:21.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303003+0000","last_change":"2024-09-19T08:43:13.501280+0000","last_active":"2024-09-19T08:44:19.303003+0000","last_peered":"2024-09-19T08:44:19.303003+0000","last_clean":"2024-09-19T08:44:19.303003+0000","last_became_active":"2024-09-19T08:43:13.500951+0000","last_became_peered":"2024-09-19T08:43:13.500951+0000","last_unstale":"2024-09-19T08:44:19.303003+0000","last_undegraded":"2024-09-19T08:44:19.303003+0000","last_fullsized":"2024-09-19T08:44:19.303003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:32.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.625900+0000","last_change":"2024-09-19T08:43:12.059831+0000","last_active":"2024-09-19T08:44:19.625900+0000","last_peered":"2024-09-19T08:44:19.625900+0000","last_clean":"2024-09-19T08:44:19.625900+0000","last_became_active":"2024-09-19T08:43:12.059476+0000","last_became_peered":"2024-09-19T08:43:12.059476+0000","last_unstale":"2024-09-19T08:44:19.625900+0000","last_undegraded":"2024-09-19T08:44:19.625900+0000","last_fullsized":"2024-09-19T08:44:19.625900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:07.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442965+0000","last_change":"2024-09-19T08:43:20.862549+0000","last_active":"2024-09-19T08:44:19.442965+0000","last_peered":"2024-09-19T08:44:19.442965+0000","last_clean":"2024-09-19T08:44:19.442965+0000","last_became_active":"2024-09-19T08:43:20.862132+0000","last_became_peered":"2024-09-19T08:43:20.862132+0000","last_unstale":"2024-09-19T08:44:19.442965+0000","last_undegraded":"2024-09-19T08:44:19.442965+0000","last_fullsized":"2024-09-19T08:44:19.442965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:21.979379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304563+0000","last_change":"2024-09-19T08:43:13.501448+0000","last_active":"2024-09-19T08:44:19.304563+0000","last_peered":"2024-09-19T08:44:19.304563+0000","last_clean":"2024-09-19T08:44:19.304563+0000","last_became_active":"2024-09-19T08:43:13.501037+0000","last_became_peered":"2024-09-19T08:43:13.501037+0000","last_unstale":"2024-09-19T08:44:19.304563+0000","last_undegraded":"2024-09-19T08:44:19.304563+0000","last_fullsized":"2024-09-19T08:44:19.304563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:55.190450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.443202+0000","last_change":"2024-09-19T08:43:11.512783+0000","last_active":"2024-09-19T08:44:19.443202+0000","last_peered":"2024-09-19T08:44:19.443202+0000","last_clean":"2024-09-19T08:44:19.443202+0000","last_became_active":"2024-09-19T08:43:11.512396+0000","last_became_peered":"2024-09-19T08:43:11.512396+0000","last_unstale":"2024-09-19T08:44:19.443202+0000","last_undegraded":"2024-09-19T08:44:19.443202+0000","last_fullsized":"2024-09-19T08:44:19.443202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.113193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306491+0000","last_change":"2024-09-19T08:43:20.539200+0000","last_active":"2024-09-19T08:44:19.306491+0000","last_peered":"2024-09-19T08:44:19.306491+0000","last_clean":"2024-09-19T08:44:19.306491+0000","last_became_active":"2024-09-19T08:43:20.538778+0000","last_became_peered":"2024-09-19T08:43:20.538778+0000","last_unstale":"2024-09-19T08:44:19.306491+0000","last_undegraded":"2024-09-19T08:44:19.306491+0000","last_fullsized":"2024-09-19T08:44:19.306491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:27.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306548+0000","last_change":"2024-09-19T08:43:13.505769+0000","last_active":"2024-09-19T08:44:19.306548+0000","last_peered":"2024-09-19T08:44:19.306548+0000","last_clean":"2024-09-19T08:44:19.306548+0000","last_became_active":"2024-09-19T08:43:13.503276+0000","last_became_peered":"2024-09-19T08:43:13.503276+0000","last_unstale":"2024-09-19T08:44:19.306548+0000","last_undegraded":"2024-09-19T08:44:19.306548+0000","last_fullsized":"2024-09-19T08:44:19.306548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:58.137325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300838+0000","last_change":"2024-09-19T08:43:11.453959+0000","last_active":"2024-09-19T08:44:19.300838+0000","last_peered":"2024-09-19T08:44:19.300838+0000","last_clean":"2024-09-19T08:44:19.300838+0000","last_became_active":"2024-09-19T08:43:11.453645+0000","last_became_peered":"2024-09-19T08:43:11.453645+0000","last_unstale":"2024-09-19T08:44:19.300838+0000","last_undegraded":"2024-09-19T08:44:19.300838+0000","last_fullsized":"2024-09-19T08:44:19.300838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:30.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306139+0000","last_change":"2024-09-19T08:43:20.861812+0000","last_active":"2024-09-19T08:44:19.306139+0000","last_peered":"2024-09-19T08:44:19.306139+0000","last_clean":"2024-09-19T08:44:19.306139+0000","last_became_active":"2024-09-19T08:43:20.861180+0000","last_became_peered":"2024-09-19T08:43:20.861180+0000","last_unstale":"2024-09-19T08:44:19.306139+0000","last_undegraded":"2024-09-19T08:44:19.306139+0000","last_fullsized":"2024-09-19T08:44:19.306139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:24.200250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303836+0000","last_change":"2024-09-19T08:43:13.500991+0000","last_active":"2024-09-19T08:44:19.303836+0000","last_peered":"2024-09-19T08:44:19.303836+0000","last_clean":"2024-09-19T08:44:19.303836+0000","last_became_active":"2024-09-19T08:43:13.500676+0000","last_became_peered":"2024-09-19T08:43:13.500676+0000","last_unstale":"2024-09-19T08:44:19.303836+0000","last_undegraded":"2024-09-19T08:44:19.303836+0000","last_fullsized":"2024-09-19T08:44:19.303836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:38.201131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304088+0000","last_change":"2024-09-19T08:43:12.059273+0000","last_active":"2024-09-19T08:44:19.304088+0000","last_peered":"2024-09-19T08:44:19.304088+0000","last_clean":"2024-09-19T08:44:19.304088+0000","last_became_active":"2024-09-19T08:43:12.058873+0000","last_became_peered":"2024-09-19T08:43:12.058873+0000","last_unstale":"2024-09-19T08:44:19.304088+0000","last_undegraded":"2024-09-19T08:44:19.304088+0000","last_fullsized":"2024-09-19T08:44:19.304088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:43.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301279+0000","last_change":"2024-09-19T08:43:20.543459+0000","last_active":"2024-09-19T08:44:19.301279+0000","last_peered":"2024-09-19T08:44:19.301279+0000","last_clean":"2024-09-19T08:44:19.301279+0000","last_became_active":"2024-09-19T08:43:20.542946+0000","last_became_peered":"2024-09-19T08:43:20.542946+0000","last_unstale":"2024-09-19T08:44:19.301279+0000","last_undegraded":"2024-09-19T08:44:19.301279+0000","last_fullsized":"2024-09-19T08:44:19.301279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:19.423576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302032+0000","last_change":"2024-09-19T08:43:13.506844+0000","last_active":"2024-09-19T08:44:19.302032+0000","last_peered":"2024-09-19T08:44:19.302032+0000","last_clean":"2024-09-19T08:44:19.302032+0000","last_became_active":"2024-09-19T08:43:13.506495+0000","last_became_peered":"2024-09-19T08:43:13.506495+0000","last_unstale":"2024-09-19T08:44:19.302032+0000","last_undegraded":"2024-09-19T08:44:19.302032+0000","last_fullsized":"2024-09-19T08:44:19.302032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:59.058100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300645+0000","last_change":"2024-09-19T08:43:12.060835+0000","last_active":"2024-09-19T08:44:19.300645+0000","last_peered":"2024-09-19T08:44:19.300645+0000","last_clean":"2024-09-19T08:44:19.300645+0000","last_became_active":"2024-09-19T08:43:12.060376+0000","last_became_peered":"2024-09-19T08:43:12.060376+0000","last_unstale":"2024-09-19T08:44:19.300645+0000","last_undegraded":"2024-09-19T08:44:19.300645+0000","last_fullsized":"2024-09-19T08:44:19.300645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:38.385378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303043+0000","last_change":"2024-09-19T08:43:20.861704+0000","last_active":"2024-09-19T08:44:19.303043+0000","last_peered":"2024-09-19T08:44:19.303043+0000","last_clean":"2024-09-19T08:44:19.303043+0000","last_became_active":"2024-09-19T08:43:20.861209+0000","last_became_peered":"2024-09-19T08:43:20.861209+0000","last_unstale":"2024-09-19T08:44:19.303043+0000","last_undegraded":"2024-09-19T08:44:19.303043+0000","last_fullsized":"2024-09-19T08:44:19.303043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:02.717283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302268+0000","last_change":"2024-09-19T08:43:13.506167+0000","last_active":"2024-09-19T08:44:19.302268+0000","last_peered":"2024-09-19T08:44:19.302268+0000","last_clean":"2024-09-19T08:44:19.302268+0000","last_became_active":"2024-09-19T08:43:13.505771+0000","last_became_peered":"2024-09-19T08:43:13.505771+0000","last_unstale":"2024-09-19T08:44:19.302268+0000","last_undegraded":"2024-09-19T08:44:19.302268+0000","last_fullsized":"2024-09-19T08:44:19.302268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:10.408410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303466+0000","last_change":"2024-09-19T08:43:11.461464+0000","last_active":"2024-09-19T08:44:19.303466+0000","last_peered":"2024-09-19T08:44:19.303466+0000","last_clean":"2024-09-19T08:44:19.303466+0000","last_became_active":"2024-09-19T08:43:11.461109+0000","last_became_peered":"2024-09-19T08:43:11.461109+0000","last_unstale":"2024-09-19T08:44:19.303466+0000","last_undegraded":"2024-09-19T08:44:19.303466+0000","last_fullsized":"2024-09-19T08:44:19.303466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:43.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303589+0000","last_change":"2024-09-19T08:43:20.539703+0000","last_active":"2024-09-19T08:44:19.303589+0000","last_peered":"2024-09-19T08:44:19.303589+0000","last_clean":"2024-09-19T08:44:19.303589+0000","last_became_active":"2024-09-19T08:43:20.538601+0000","last_became_peered":"2024-09-19T08:43:20.538601+0000","last_unstale":"2024-09-19T08:44:19.303589+0000","last_undegraded":"2024-09-19T08:44:19.303589+0000","last_fullsized":"2024-09-19T08:44:19.303589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:09.306293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306317+0000","last_change":"2024-09-19T08:43:13.511861+0000","last_active":"2024-09-19T08:44:19.306317+0000","last_peered":"2024-09-19T08:44:19.306317+0000","last_clean":"2024-09-19T08:44:19.306317+0000","last_became_active":"2024-09-19T08:43:13.511426+0000","last_became_peered":"2024-09-19T08:43:13.511426+0000","last_unstale":"2024-09-19T08:44:19.306317+0000","last_undegraded":"2024-09-19T08:44:19.306317+0000","last_fullsized":"2024-09-19T08:44:19.306317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:06.975135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303300+0000","last_change":"2024-09-19T08:43:12.059704+0000","last_active":"2024-09-19T08:44:19.303300+0000","last_peered":"2024-09-19T08:44:19.303300+0000","last_clean":"2024-09-19T08:44:19.303300+0000","last_became_active":"2024-09-19T08:43:12.059338+0000","last_became_peered":"2024-09-19T08:43:12.059338+0000","last_unstale":"2024-09-19T08:44:19.303300+0000","last_undegraded":"2024-09-19T08:44:19.303300+0000","last_fullsized":"2024-09-19T08:44:19.303300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:03.336909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303841+0000","last_change":"2024-09-19T08:43:20.861308+0000","last_active":"2024-09-19T08:44:19.303841+0000","last_peered":"2024-09-19T08:44:19.303841+0000","last_clean":"2024-09-19T08:44:19.303841+0000","last_became_active":"2024-09-19T08:43:20.860901+0000","last_became_peered":"2024-09-19T08:43:20.860901+0000","last_unstale":"2024-09-19T08:44:19.303841+0000","last_undegraded":"2024-09-19T08:44:19.303841+0000","last_fullsized":"2024-09-19T08:44:19.303841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:15.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303079+0000","last_change":"2024-09-19T08:43:13.501723+0000","last_active":"2024-09-19T08:44:19.303079+0000","last_peered":"2024-09-19T08:44:19.303079+0000","last_clean":"2024-09-19T08:44:19.303079+0000","last_became_active":"2024-09-19T08:43:13.501427+0000","last_became_peered":"2024-09-19T08:43:13.501427+0000","last_unstale":"2024-09-19T08:44:19.303079+0000","last_undegraded":"2024-09-19T08:44:19.303079+0000","last_fullsized":"2024-09-19T08:44:19.303079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:26.870460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.312475+0000","last_change":"2024-09-19T08:44:19.310765+0000","last_active":"2024-09-19T08:44:19.312475+0000","last_peered":"2024-09-19T08:44:19.312475+0000","last_clean":"2024-09-19T08:44:19.312475+0000","last_became_active":"2024-09-19T08:44:19.310370+0000","last_became_peered":"2024-09-19T08:44:19.310370+0000","last_unstale":"2024-09-19T08:44:19.312475+0000","last_undegraded":"2024-09-19T08:44:19.312475+0000","last_fullsized":"2024-09-19T08:44:19.312475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:33.759809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305851+0000","last_change":"2024-09-19T08:43:20.862595+0000","last_active":"2024-09-19T08:44:19.305851+0000","last_peered":"2024-09-19T08:44:19.305851+0000","last_clean":"2024-09-19T08:44:19.305851+0000","last_became_active":"2024-09-19T08:43:20.862143+0000","last_became_peered":"2024-09-19T08:43:20.862143+0000","last_unstale":"2024-09-19T08:44:19.305851+0000","last_undegraded":"2024-09-19T08:44:19.305851+0000","last_fullsized":"2024-09-19T08:44:19.305851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.653517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306503+0000","last_change":"2024-09-19T08:43:13.513129+0000","last_active":"2024-09-19T08:44:19.306503+0000","last_peered":"2024-09-19T08:44:19.306503+0000","last_clean":"2024-09-19T08:44:19.306503+0000","last_became_active":"2024-09-19T08:43:13.512681+0000","last_became_peered":"2024-09-19T08:43:13.512681+0000","last_unstale":"2024-09-19T08:44:19.306503+0000","last_undegraded":"2024-09-19T08:44:19.306503+0000","last_fullsized":"2024-09-19T08:44:19.306503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:50.057369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.443130+0000","last_change":"2024-09-19T08:43:11.461772+0000","last_active":"2024-09-19T08:44:19.443130+0000","last_peered":"2024-09-19T08:44:19.443130+0000","last_clean":"2024-09-19T08:44:19.443130+0000","last_became_active":"2024-09-19T08:43:11.461066+0000","last_became_peered":"2024-09-19T08:43:11.461066+0000","last_unstale":"2024-09-19T08:44:19.443130+0000","last_undegraded":"2024-09-19T08:44:19.443130+0000","last_fullsized":"2024-09-19T08:44:19.443130+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:55.360550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303377+0000","last_change":"2024-09-19T08:41:59.671692+0000","last_active":"2024-09-19T08:44:19.303377+0000","last_peered":"2024-09-19T08:44:19.303377+0000","last_clean":"2024-09-19T08:44:19.303377+0000","last_became_active":"2024-09-19T08:41:59.671224+0000","last_became_peered":"2024-09-19T08:41:59.671224+0000","last_unstale":"2024-09-19T08:44:19.303377+0000","last_undegraded":"2024-09-19T08:44:19.303377+0000","last_fullsized":"2024-09-19T08:44:19.303377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_clean_scrub_stamp":"2024-09-19T08:38:34.722787+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:50.768501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303773+0000","last_change":"2024-09-19T08:43:20.545612+0000","last_active":"2024-09-19T08:44:19.303773+0000","last_peered":"2024-09-19T08:44:19.303773+0000","last_clean":"2024-09-19T08:44:19.303773+0000","last_became_active":"2024-09-19T08:43:20.545236+0000","last_became_peered":"2024-09-19T08:43:20.545236+0000","last_unstale":"2024-09-19T08:44:19.303773+0000","last_undegraded":"2024-09-19T08:44:19.303773+0000","last_fullsized":"2024-09-19T08:44:19.303773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:53.972567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303961+0000","last_change":"2024-09-19T08:43:13.514014+0000","last_active":"2024-09-19T08:44:19.303961+0000","last_peered":"2024-09-19T08:44:19.303961+0000","last_clean":"2024-09-19T08:44:19.303961+0000","last_became_active":"2024-09-19T08:43:13.513492+0000","last_became_peered":"2024-09-19T08:43:13.513492+0000","last_unstale":"2024-09-19T08:44:19.303961+0000","last_undegraded":"2024-09-19T08:44:19.303961+0000","last_fullsized":"2024-09-19T08:44:19.303961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:17.914628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307582+0000","last_change":"2024-09-19T08:43:12.059822+0000","last_active":"2024-09-19T08:44:19.307582+0000","last_peered":"2024-09-19T08:44:19.307582+0000","last_clean":"2024-09-19T08:44:19.307582+0000","last_became_active":"2024-09-19T08:43:12.059469+0000","last_became_peered":"2024-09-19T08:43:12.059469+0000","last_unstale":"2024-09-19T08:44:19.307582+0000","last_undegraded":"2024-09-19T08:44:19.307582+0000","last_fullsized":"2024-09-19T08:44:19.307582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:22.283239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.625985+0000","last_change":"2024-09-19T08:43:20.533058+0000","last_active":"2024-09-19T08:44:19.625985+0000","last_peered":"2024-09-19T08:44:19.625985+0000","last_clean":"2024-09-19T08:44:19.625985+0000","last_became_active":"2024-09-19T08:43:20.532573+0000","last_became_peered":"2024-09-19T08:43:20.532573+0000","last_unstale":"2024-09-19T08:44:19.625985+0000","last_undegraded":"2024-09-19T08:44:19.625985+0000","last_fullsized":"2024-09-19T08:44:19.625985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:30.449747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309383+0000","last_change":"2024-09-19T08:44:19.309383+0000","last_active":"2024-09-19T08:44:19.309383+0000","last_peered":"2024-09-19T08:44:19.309383+0000","last_clean":"2024-09-19T08:44:19.309383+0000","last_became_active":"2024-09-19T08:44:19.309043+0000","last_became_peered":"2024-09-19T08:44:19.309043+0000","last_unstale":"2024-09-19T08:44:19.309383+0000","last_undegraded":"2024-09-19T08:44:19.309383+0000","last_fullsized":"2024-09-19T08:44:19.309383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:20.096915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307406+0000","last_change":"2024-09-19T08:43:11.461700+0000","last_active":"2024-09-19T08:44:19.307406+0000","last_peered":"2024-09-19T08:44:19.307406+0000","last_clean":"2024-09-19T08:44:19.307406+0000","last_became_active":"2024-09-19T08:43:11.461340+0000","last_became_peered":"2024-09-19T08:43:11.461340+0000","last_unstale":"2024-09-19T08:44:19.307406+0000","last_undegraded":"2024-09-19T08:44:19.307406+0000","last_fullsized":"2024-09-19T08:44:19.307406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:00.331483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304515+0000","last_change":"2024-09-19T08:43:20.541431+0000","last_active":"2024-09-19T08:44:19.304515+0000","last_peered":"2024-09-19T08:44:19.304515+0000","last_clean":"2024-09-19T08:44:19.304515+0000","last_became_active":"2024-09-19T08:43:20.540990+0000","last_became_peered":"2024-09-19T08:43:20.540990+0000","last_unstale":"2024-09-19T08:44:19.304515+0000","last_undegraded":"2024-09-19T08:44:19.304515+0000","last_fullsized":"2024-09-19T08:44:19.304515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:45.733086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303949+0000","last_change":"2024-09-19T08:43:13.505948+0000","last_active":"2024-09-19T08:44:19.303949+0000","last_peered":"2024-09-19T08:44:19.303949+0000","last_clean":"2024-09-19T08:44:19.303949+0000","last_became_active":"2024-09-19T08:43:13.505600+0000","last_became_peered":"2024-09-19T08:43:13.505600+0000","last_unstale":"2024-09-19T08:44:19.303949+0000","last_undegraded":"2024-09-19T08:44:19.303949+0000","last_fullsized":"2024-09-19T08:44:19.303949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:06.461033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.448125+0000","last_change":"2024-09-19T08:44:19.448125+0000","last_active":"2024-09-19T08:44:19.448125+0000","last_peered":"2024-09-19T08:44:19.448125+0000","last_clean":"2024-09-19T08:44:19.448125+0000","last_became_active":"2024-09-19T08:44:19.444107+0000","last_became_peered":"2024-09-19T08:44:19.444107+0000","last_unstale":"2024-09-19T08:44:19.448125+0000","last_undegraded":"2024-09-19T08:44:19.448125+0000","last_fullsized":"2024-09-19T08:44:19.448125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:53.979830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305794+0000","last_change":"2024-09-19T08:43:20.539563+0000","last_active":"2024-09-19T08:44:19.305794+0000","last_peered":"2024-09-19T08:44:19.305794+0000","last_clean":"2024-09-19T08:44:19.305794+0000","last_became_active":"2024-09-19T08:43:20.539164+0000","last_became_peered":"2024-09-19T08:43:20.539164+0000","last_unstale":"2024-09-19T08:44:19.305794+0000","last_undegraded":"2024-09-19T08:44:19.305794+0000","last_fullsized":"2024-09-19T08:44:19.305794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:06.285326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301905+0000","last_change":"2024-09-19T08:43:13.513618+0000","last_active":"2024-09-19T08:44:19.301905+0000","last_peered":"2024-09-19T08:44:19.301905+0000","last_clean":"2024-09-19T08:44:19.301905+0000","last_became_active":"2024-09-19T08:43:13.513281+0000","last_became_peered":"2024-09-19T08:43:13.513281+0000","last_unstale":"2024-09-19T08:44:19.301905+0000","last_undegraded":"2024-09-19T08:44:19.301905+0000","last_fullsized":"2024-09-19T08:44:19.301905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:40.874071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303818+0000","last_change":"2024-09-19T08:43:11.457087+0000","last_active":"2024-09-19T08:44:19.303818+0000","last_peered":"2024-09-19T08:44:19.303818+0000","last_clean":"2024-09-19T08:44:19.303818+0000","last_became_active":"2024-09-19T08:43:11.456687+0000","last_became_peered":"2024-09-19T08:43:11.456687+0000","last_unstale":"2024-09-19T08:44:19.303818+0000","last_undegraded":"2024-09-19T08:44:19.303818+0000","last_fullsized":"2024-09-19T08:44:19.303818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:40.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305287+0000","last_change":"2024-09-19T08:43:20.540740+0000","last_active":"2024-09-19T08:44:19.305287+0000","last_peered":"2024-09-19T08:44:19.305287+0000","last_clean":"2024-09-19T08:44:19.305287+0000","last_became_active":"2024-09-19T08:43:20.540044+0000","last_became_peered":"2024-09-19T08:43:20.540044+0000","last_unstale":"2024-09-19T08:44:19.305287+0000","last_undegraded":"2024-09-19T08:44:19.305287+0000","last_fullsized":"2024-09-19T08:44:19.305287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:11.238259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305492+0000","last_change":"2024-09-19T08:43:13.514193+0000","last_active":"2024-09-19T08:44:19.305492+0000","last_peered":"2024-09-19T08:44:19.305492+0000","last_clean":"2024-09-19T08:44:19.305492+0000","last_became_active":"2024-09-19T08:43:13.513864+0000","last_became_peered":"2024-09-19T08:43:13.513864+0000","last_unstale":"2024-09-19T08:44:19.305492+0000","last_undegraded":"2024-09-19T08:44:19.305492+0000","last_fullsized":"2024-09-19T08:44:19.305492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:15.575162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304300+0000","last_change":"2024-09-19T08:43:12.059836+0000","last_active":"2024-09-19T08:44:19.304300+0000","last_peered":"2024-09-19T08:44:19.304300+0000","last_clean":"2024-09-19T08:44:19.304300+0000","last_became_active":"2024-09-19T08:43:12.059459+0000","last_became_peered":"2024-09-19T08:43:12.059459+0000","last_unstale":"2024-09-19T08:44:19.304300+0000","last_undegraded":"2024-09-19T08:44:19.304300+0000","last_fullsized":"2024-09-19T08:44:19.304300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:53.932649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304002+0000","last_change":"2024-09-19T08:43:20.540919+0000","last_active":"2024-09-19T08:44:19.304002+0000","last_peered":"2024-09-19T08:44:19.304002+0000","last_clean":"2024-09-19T08:44:19.304002+0000","last_became_active":"2024-09-19T08:43:20.540535+0000","last_became_peered":"2024-09-19T08:43:20.540535+0000","last_unstale":"2024-09-19T08:44:19.304002+0000","last_undegraded":"2024-09-19T08:44:19.304002+0000","last_fullsized":"2024-09-19T08:44:19.304002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:32.767025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302938+0000","last_change":"2024-09-19T08:43:13.511693+0000","last_active":"2024-09-19T08:44:19.302938+0000","last_peered":"2024-09-19T08:44:19.302938+0000","last_clean":"2024-09-19T08:44:19.302938+0000","last_became_active":"2024-09-19T08:43:13.511347+0000","last_became_peered":"2024-09-19T08:43:13.511347+0000","last_unstale":"2024-09-19T08:44:19.302938+0000","last_undegraded":"2024-09-19T08:44:19.302938+0000","last_fullsized":"2024-09-19T08:44:19.302938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:22.146900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442626+0000","last_change":"2024-09-19T08:43:11.461514+0000","last_active":"2024-09-19T08:44:19.442626+0000","last_peered":"2024-09-19T08:44:19.442626+0000","last_clean":"2024-09-19T08:44:19.442626+0000","last_became_active":"2024-09-19T08:43:11.461079+0000","last_became_peered":"2024-09-19T08:43:11.461079+0000","last_unstale":"2024-09-19T08:44:19.442626+0000","last_undegraded":"2024-09-19T08:44:19.442626+0000","last_fullsized":"2024-09-19T08:44:19.442626+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:10.978243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300766+0000","last_change":"2024-09-19T08:43:20.546834+0000","last_active":"2024-09-19T08:44:19.300766+0000","last_peered":"2024-09-19T08:44:19.300766+0000","last_clean":"2024-09-19T08:44:19.300766+0000","last_became_active":"2024-09-19T08:43:20.545732+0000","last_became_peered":"2024-09-19T08:43:20.545732+0000","last_unstale":"2024-09-19T08:44:19.300766+0000","last_undegraded":"2024-09-19T08:44:19.300766+0000","last_fullsized":"2024-09-19T08:44:19.300766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:56.570928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303214+0000","last_change":"2024-09-19T08:43:13.508295+0000","last_active":"2024-09-19T08:44:19.303214+0000","last_peered":"2024-09-19T08:44:19.303214+0000","last_clean":"2024-09-19T08:44:19.303214+0000","last_became_active":"2024-09-19T08:43:13.507988+0000","last_became_peered":"2024-09-19T08:43:13.507988+0000","last_unstale":"2024-09-19T08:44:19.303214+0000","last_undegraded":"2024-09-19T08:44:19.303214+0000","last_fullsized":"2024-09-19T08:44:19.303214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:33.473262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306486+0000","last_change":"2024-09-19T08:43:11.457965+0000","last_active":"2024-09-19T08:44:19.306486+0000","last_peered":"2024-09-19T08:44:19.306486+0000","last_clean":"2024-09-19T08:44:19.306486+0000","last_became_active":"2024-09-19T08:43:11.456616+0000","last_became_peered":"2024-09-19T08:43:11.456616+0000","last_unstale":"2024-09-19T08:44:19.306486+0000","last_undegraded":"2024-09-19T08:44:19.306486+0000","last_fullsized":"2024-09-19T08:44:19.306486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:17.635896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301235+0000","last_change":"2024-09-19T08:43:20.546848+0000","last_active":"2024-09-19T08:44:19.301235+0000","last_peered":"2024-09-19T08:44:19.301235+0000","last_clean":"2024-09-19T08:44:19.301235+0000","last_became_active":"2024-09-19T08:43:20.546430+0000","last_became_peered":"2024-09-19T08:43:20.546430+0000","last_unstale":"2024-09-19T08:44:19.301235+0000","last_undegraded":"2024-09-19T08:44:19.301235+0000","last_fullsized":"2024-09-19T08:44:19.301235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:39.031339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303948+0000","last_change":"2024-09-19T08:43:13.499817+0000","last_active":"2024-09-19T08:44:19.303948+0000","last_peered":"2024-09-19T08:44:19.303948+0000","last_clean":"2024-09-19T08:44:19.303948+0000","last_became_active":"2024-09-19T08:43:13.499446+0000","last_became_peered":"2024-09-19T08:43:13.499446+0000","last_unstale":"2024-09-19T08:44:19.303948+0000","last_undegraded":"2024-09-19T08:44:19.303948+0000","last_fullsized":"2024-09-19T08:44:19.303948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:04.093262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.308275+0000","last_change":"2024-09-19T08:43:11.464099+0000","last_active":"2024-09-19T08:44:19.308275+0000","last_peered":"2024-09-19T08:44:19.308275+0000","last_clean":"2024-09-19T08:44:19.308275+0000","last_became_active":"2024-09-19T08:43:11.463735+0000","last_became_peered":"2024-09-19T08:43:11.463735+0000","last_unstale":"2024-09-19T08:44:19.308275+0000","last_undegraded":"2024-09-19T08:44:19.308275+0000","last_fullsized":"2024-09-19T08:44:19.308275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:10.951239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307031+0000","last_change":"2024-09-19T08:43:20.537810+0000","last_active":"2024-09-19T08:44:19.307031+0000","last_peered":"2024-09-19T08:44:19.307031+0000","last_clean":"2024-09-19T08:44:19.307031+0000","last_became_active":"2024-09-19T08:43:20.537355+0000","last_became_peered":"2024-09-19T08:43:20.537355+0000","last_unstale":"2024-09-19T08:44:19.307031+0000","last_undegraded":"2024-09-19T08:44:19.307031+0000","last_fullsized":"2024-09-19T08:44:19.307031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:55.767023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303733+0000","last_change":"2024-09-19T08:43:13.502536+0000","last_active":"2024-09-19T08:44:19.303733+0000","last_peered":"2024-09-19T08:44:19.303733+0000","last_clean":"2024-09-19T08:44:19.303733+0000","last_became_active":"2024-09-19T08:43:13.500808+0000","last_became_peered":"2024-09-19T08:43:13.500808+0000","last_unstale":"2024-09-19T08:44:19.303733+0000","last_undegraded":"2024-09-19T08:44:19.303733+0000","last_fullsized":"2024-09-19T08:44:19.303733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:51.902896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":176,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:45.725991+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:44:45.725991+0000","last_peered":"2024-09-19T08:44:45.725991+0000","last_clean":"2024-09-19T08:44:45.725991+0000","last_became_active":"2024-09-19T08:43:11.463756+0000","last_became_peered":"2024-09-19T08:43:11.463756+0000","last_unstale":"2024-09-19T08:44:45.725991+0000","last_undegraded":"2024-09-19T08:44:45.725991+0000","last_fullsized":"2024-09-19T08:44:45.725991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:39.124949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":118,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300389+0000","last_change":"2024-09-19T08:43:20.546900+0000","last_active":"2024-09-19T08:44:19.300389+0000","last_peered":"2024-09-19T08:44:19.300389+0000","last_clean":"2024-09-19T08:44:19.300389+0000","last_became_active":"2024-09-19T08:43:20.545914+0000","last_became_peered":"2024-09-19T08:43:20.545914+0000","last_unstale":"2024-09-19T08:44:19.300389+0000","last_undegraded":"2024-09-19T08:44:19.300389+0000","last_fullsized":"2024-09-19T08:44:19.300389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:02.842999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626268+0000","last_change":"2024-09-19T08:43:13.510848+0000","last_active":"2024-09-19T08:44:19.626268+0000","last_peered":"2024-09-19T08:44:19.626268+0000","last_clean":"2024-09-19T08:44:19.626268+0000","last_became_active":"2024-09-19T08:43:13.510224+0000","last_became_peered":"2024-09-19T08:43:13.510224+0000","last_unstale":"2024-09-19T08:44:19.626268+0000","last_undegraded":"2024-09-19T08:44:19.626268+0000","last_fullsized":"2024-09-19T08:44:19.626268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:56.113933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307304+0000","last_change":"2024-09-19T08:43:12.061493+0000","last_active":"2024-09-19T08:44:19.307304+0000","last_peered":"2024-09-19T08:44:19.307304+0000","last_clean":"2024-09-19T08:44:19.307304+0000","last_became_active":"2024-09-19T08:43:12.061157+0000","last_became_peered":"2024-09-19T08:43:12.061157+0000","last_unstale":"2024-09-19T08:44:19.307304+0000","last_undegraded":"2024-09-19T08:44:19.307304+0000","last_fullsized":"2024-09-19T08:44:19.307304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:59.542997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442683+0000","last_change":"2024-09-19T08:43:20.546703+0000","last_active":"2024-09-19T08:44:19.442683+0000","last_peered":"2024-09-19T08:44:19.442683+0000","last_clean":"2024-09-19T08:44:19.442683+0000","last_became_active":"2024-09-19T08:43:20.546247+0000","last_became_peered":"2024-09-19T08:43:20.546247+0000","last_unstale":"2024-09-19T08:44:19.442683+0000","last_undegraded":"2024-09-19T08:44:19.442683+0000","last_fullsized":"2024-09-19T08:44:19.442683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:53.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309808+0000","last_change":"2024-09-19T08:44:19.309808+0000","last_active":"2024-09-19T08:44:19.309808+0000","last_peered":"2024-09-19T08:44:19.309808+0000","last_clean":"2024-09-19T08:44:19.309808+0000","last_became_active":"2024-09-19T08:44:19.309286+0000","last_became_peered":"2024-09-19T08:44:19.309286+0000","last_unstale":"2024-09-19T08:44:19.309808+0000","last_undegraded":"2024-09-19T08:44:19.309808+0000","last_fullsized":"2024-09-19T08:44:19.309808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:28.825203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303775+0000","last_change":"2024-09-19T08:43:11.460928+0000","last_active":"2024-09-19T08:44:19.303775+0000","last_peered":"2024-09-19T08:44:19.303775+0000","last_clean":"2024-09-19T08:44:19.303775+0000","last_became_active":"2024-09-19T08:43:11.460555+0000","last_became_peered":"2024-09-19T08:43:11.460555+0000","last_unstale":"2024-09-19T08:44:19.303775+0000","last_undegraded":"2024-09-19T08:44:19.303775+0000","last_fullsized":"2024-09-19T08:44:19.303775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:21.671235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300222+0000","last_change":"2024-09-19T08:43:20.547775+0000","last_active":"2024-09-19T08:44:19.300222+0000","last_peered":"2024-09-19T08:44:19.300222+0000","last_clean":"2024-09-19T08:44:19.300222+0000","last_became_active":"2024-09-19T08:43:20.547318+0000","last_became_peered":"2024-09-19T08:43:20.547318+0000","last_unstale":"2024-09-19T08:44:19.300222+0000","last_undegraded":"2024-09-19T08:44:19.300222+0000","last_fullsized":"2024-09-19T08:44:19.300222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:14.925314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626622+0000","last_change":"2024-09-19T08:43:13.511510+0000","last_active":"2024-09-19T08:44:19.626622+0000","last_peered":"2024-09-19T08:44:19.626622+0000","last_clean":"2024-09-19T08:44:19.626622+0000","last_became_active":"2024-09-19T08:43:13.511184+0000","last_became_peered":"2024-09-19T08:43:13.511184+0000","last_unstale":"2024-09-19T08:44:19.626622+0000","last_undegraded":"2024-09-19T08:44:19.626622+0000","last_fullsized":"2024-09-19T08:44:19.626622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:23.864506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302187+0000","last_change":"2024-09-19T08:43:11.460981+0000","last_active":"2024-09-19T08:44:19.302187+0000","last_peered":"2024-09-19T08:44:19.302187+0000","last_clean":"2024-09-19T08:44:19.302187+0000","last_became_active":"2024-09-19T08:43:11.460484+0000","last_became_peered":"2024-09-19T08:43:11.460484+0000","last_unstale":"2024-09-19T08:44:19.302187+0000","last_undegraded":"2024-09-19T08:44:19.302187+0000","last_fullsized":"2024-09-19T08:44:19.302187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:35.952469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306683+0000","last_change":"2024-09-19T08:43:20.544626+0000","last_active":"2024-09-19T08:44:19.306683+0000","last_peered":"2024-09-19T08:44:19.306683+0000","last_clean":"2024-09-19T08:44:19.306683+0000","last_became_active":"2024-09-19T08:43:20.543836+0000","last_became_peered":"2024-09-19T08:43:20.543836+0000","last_unstale":"2024-09-19T08:44:19.306683+0000","last_undegraded":"2024-09-19T08:44:19.306683+0000","last_fullsized":"2024-09-19T08:44:19.306683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:17.508084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304303+0000","last_change":"2024-09-19T08:43:20.539467+0000","last_active":"2024-09-19T08:44:19.304303+0000","last_peered":"2024-09-19T08:44:19.304303+0000","last_clean":"2024-09-19T08:44:19.304303+0000","last_became_active":"2024-09-19T08:43:20.539077+0000","last_became_peered":"2024-09-19T08:43:20.539077+0000","last_unstale":"2024-09-19T08:44:19.304303+0000","last_undegraded":"2024-09-19T08:44:19.304303+0000","last_fullsized":"2024-09-19T08:44:19.304303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:10.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300847+0000","last_change":"2024-09-19T08:43:13.505261+0000","last_active":"2024-09-19T08:44:19.300847+0000","last_peered":"2024-09-19T08:44:19.300847+0000","last_clean":"2024-09-19T08:44:19.300847+0000","last_became_active":"2024-09-19T08:43:13.504984+0000","last_became_peered":"2024-09-19T08:43:13.504984+0000","last_unstale":"2024-09-19T08:44:19.300847+0000","last_undegraded":"2024-09-19T08:44:19.300847+0000","last_fullsized":"2024-09-19T08:44:19.300847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:34.074003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306434+0000","last_change":"2024-09-19T08:43:11.457207+0000","last_active":"2024-09-19T08:44:19.306434+0000","last_peered":"2024-09-19T08:44:19.306434+0000","last_clean":"2024-09-19T08:44:19.306434+0000","last_became_active":"2024-09-19T08:43:11.456827+0000","last_became_peered":"2024-09-19T08:43:11.456827+0000","last_unstale":"2024-09-19T08:44:19.306434+0000","last_undegraded":"2024-09-19T08:44:19.306434+0000","last_fullsized":"2024-09-19T08:44:19.306434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:51.552985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301523+0000","last_change":"2024-09-19T08:43:20.547563+0000","last_active":"2024-09-19T08:44:19.301523+0000","last_peered":"2024-09-19T08:44:19.301523+0000","last_clean":"2024-09-19T08:44:19.301523+0000","last_became_active":"2024-09-19T08:43:20.546909+0000","last_became_peered":"2024-09-19T08:43:20.546909+0000","last_unstale":"2024-09-19T08:44:19.301523+0000","last_undegraded":"2024-09-19T08:44:19.301523+0000","last_fullsized":"2024-09-19T08:44:19.301523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:22.616336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306936+0000","last_change":"2024-09-19T08:43:13.498744+0000","last_active":"2024-09-19T08:44:19.306936+0000","last_peered":"2024-09-19T08:44:19.306936+0000","last_clean":"2024-09-19T08:44:19.306936+0000","last_became_active":"2024-09-19T08:43:13.498459+0000","last_became_peered":"2024-09-19T08:43:13.498459+0000","last_unstale":"2024-09-19T08:44:19.306936+0000","last_undegraded":"2024-09-19T08:44:19.306936+0000","last_fullsized":"2024-09-19T08:44:19.306936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:55.743244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303192+0000","last_change":"2024-09-19T08:43:11.455855+0000","last_active":"2024-09-19T08:44:19.303192+0000","last_peered":"2024-09-19T08:44:19.303192+0000","last_clean":"2024-09-19T08:44:19.303192+0000","last_became_active":"2024-09-19T08:43:11.455450+0000","last_became_peered":"2024-09-19T08:43:11.455450+0000","last_unstale":"2024-09-19T08:44:19.303192+0000","last_undegraded":"2024-09-19T08:44:19.303192+0000","last_fullsized":"2024-09-19T08:44:19.303192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:45.223953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302058+0000","last_change":"2024-09-19T08:43:11.462187+0000","last_active":"2024-09-19T08:44:19.302058+0000","last_peered":"2024-09-19T08:44:19.302058+0000","last_clean":"2024-09-19T08:44:19.302058+0000","last_became_active":"2024-09-19T08:43:11.461820+0000","last_became_peered":"2024-09-19T08:43:11.461820+0000","last_unstale":"2024-09-19T08:44:19.302058+0000","last_undegraded":"2024-09-19T08:44:19.302058+0000","last_fullsized":"2024-09-19T08:44:19.302058+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.910058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.311045+0000","last_change":"2024-09-19T08:44:19.311045+0000","last_active":"2024-09-19T08:44:19.311045+0000","last_peered":"2024-09-19T08:44:19.311045+0000","last_clean":"2024-09-19T08:44:19.311045+0000","last_became_active":"2024-09-19T08:44:19.310556+0000","last_became_peered":"2024-09-19T08:44:19.310556+0000","last_unstale":"2024-09-19T08:44:19.311045+0000","last_undegraded":"2024-09-19T08:44:19.311045+0000","last_fullsized":"2024-09-19T08:44:19.311045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.457039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306586+0000","last_change":"2024-09-19T08:43:20.550696+0000","last_active":"2024-09-19T08:44:19.306586+0000","last_peered":"2024-09-19T08:44:19.306586+0000","last_clean":"2024-09-19T08:44:19.306586+0000","last_became_active":"2024-09-19T08:43:20.550289+0000","last_became_peered":"2024-09-19T08:43:20.550289+0000","last_unstale":"2024-09-19T08:44:19.306586+0000","last_undegraded":"2024-09-19T08:44:19.306586+0000","last_fullsized":"2024-09-19T08:44:19.306586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:57.549540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306718+0000","last_change":"2024-09-19T08:43:11.460452+0000","last_active":"2024-09-19T08:44:19.306718+0000","last_peered":"2024-09-19T08:44:19.306718+0000","last_clean":"2024-09-19T08:44:19.306718+0000","last_became_active":"2024-09-19T08:43:11.460113+0000","last_became_peered":"2024-09-19T08:43:11.460113+0000","last_unstale":"2024-09-19T08:44:19.306718+0000","last_undegraded":"2024-09-19T08:44:19.306718+0000","last_fullsized":"2024-09-19T08:44:19.306718+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:02.112243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303468+0000","last_change":"2024-09-19T08:43:13.506092+0000","last_active":"2024-09-19T08:44:19.303468+0000","last_peered":"2024-09-19T08:44:19.303468+0000","last_clean":"2024-09-19T08:44:19.303468+0000","last_became_active":"2024-09-19T08:43:13.505715+0000","last_became_peered":"2024-09-19T08:43:13.505715+0000","last_unstale":"2024-09-19T08:44:19.303468+0000","last_undegraded":"2024-09-19T08:44:19.303468+0000","last_fullsized":"2024-09-19T08:44:19.303468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:30.256482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306500+0000","last_change":"2024-09-19T08:43:20.540759+0000","last_active":"2024-09-19T08:44:19.306500+0000","last_peered":"2024-09-19T08:44:19.306500+0000","last_clean":"2024-09-19T08:44:19.306500+0000","last_became_active":"2024-09-19T08:43:20.540275+0000","last_became_peered":"2024-09-19T08:43:20.540275+0000","last_unstale":"2024-09-19T08:44:19.306500+0000","last_undegraded":"2024-09-19T08:44:19.306500+0000","last_fullsized":"2024-09-19T08:44:19.306500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:20.032982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309950+0000","last_change":"2024-09-19T08:44:19.309950+0000","last_active":"2024-09-19T08:44:19.309950+0000","last_peered":"2024-09-19T08:44:19.309950+0000","last_clean":"2024-09-19T08:44:19.309950+0000","last_became_active":"2024-09-19T08:44:19.309553+0000","last_became_peered":"2024-09-19T08:44:19.309553+0000","last_unstale":"2024-09-19T08:44:19.309950+0000","last_undegraded":"2024-09-19T08:44:19.309950+0000","last_fullsized":"2024-09-19T08:44:19.309950+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:20.038745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306745+0000","last_change":"2024-09-19T08:43:13.507735+0000","last_active":"2024-09-19T08:44:19.306745+0000","last_peered":"2024-09-19T08:44:19.306745+0000","last_clean":"2024-09-19T08:44:19.306745+0000","last_became_active":"2024-09-19T08:43:13.507279+0000","last_became_peered":"2024-09-19T08:43:13.507279+0000","last_unstale":"2024-09-19T08:44:19.306745+0000","last_undegraded":"2024-09-19T08:44:19.306745+0000","last_fullsized":"2024-09-19T08:44:19.306745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:48.920412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306788+0000","last_change":"2024-09-19T08:43:13.504453+0000","last_active":"2024-09-19T08:44:19.306788+0000","last_peered":"2024-09-19T08:44:19.306788+0000","last_clean":"2024-09-19T08:44:19.306788+0000","last_became_active":"2024-09-19T08:43:13.503985+0000","last_became_peered":"2024-09-19T08:43:13.503985+0000","last_unstale":"2024-09-19T08:44:19.306788+0000","last_undegraded":"2024-09-19T08:44:19.306788+0000","last_fullsized":"2024-09-19T08:44:19.306788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:38.641817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303661+0000","last_change":"2024-09-19T08:43:13.509833+0000","last_active":"2024-09-19T08:44:19.303661+0000","last_peered":"2024-09-19T08:44:19.303661+0000","last_clean":"2024-09-19T08:44:19.303661+0000","last_became_active":"2024-09-19T08:43:13.509523+0000","last_became_peered":"2024-09-19T08:43:13.509523+0000","last_unstale":"2024-09-19T08:44:19.303661+0000","last_undegraded":"2024-09-19T08:44:19.303661+0000","last_fullsized":"2024-09-19T08:44:19.303661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:59.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303731+0000","last_change":"2024-09-19T08:43:13.502624+0000","last_active":"2024-09-19T08:44:19.303731+0000","last_peered":"2024-09-19T08:44:19.303731+0000","last_clean":"2024-09-19T08:44:19.303731+0000","last_became_active":"2024-09-19T08:43:13.502321+0000","last_became_peered":"2024-09-19T08:43:13.502321+0000","last_unstale":"2024-09-19T08:44:19.303731+0000","last_undegraded":"2024-09-19T08:44:19.303731+0000","last_fullsized":"2024-09-19T08:44:19.303731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:41.724026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301670+0000","last_change":"2024-09-19T08:43:13.515261+0000","last_active":"2024-09-19T08:44:19.301670+0000","last_peered":"2024-09-19T08:44:19.301670+0000","last_clean":"2024-09-19T08:44:19.301670+0000","last_became_active":"2024-09-19T08:43:13.514741+0000","last_became_peered":"2024-09-19T08:43:13.514741+0000","last_unstale":"2024-09-19T08:44:19.301670+0000","last_undegraded":"2024-09-19T08:44:19.301670+0000","last_fullsized":"2024-09-19T08:44:19.301670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:16.348859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307699+0000","last_change":"2024-09-19T08:43:13.512820+0000","last_active":"2024-09-19T08:44:19.307699+0000","last_peered":"2024-09-19T08:44:19.307699+0000","last_clean":"2024-09-19T08:44:19.307699+0000","last_became_active":"2024-09-19T08:43:13.512503+0000","last_became_peered":"2024-09-19T08:43:13.512503+0000","last_unstale":"2024-09-19T08:44:19.307699+0000","last_undegraded":"2024-09-19T08:44:19.307699+0000","last_fullsized":"2024-09-19T08:44:19.307699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:41.763855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306436+0000","last_change":"2024-09-19T08:43:13.501837+0000","last_active":"2024-09-19T08:44:19.306436+0000","last_peered":"2024-09-19T08:44:19.306436+0000","last_clean":"2024-09-19T08:44:19.306436+0000","last_became_active":"2024-09-19T08:43:13.501561+0000","last_became_peered":"2024-09-19T08:43:13.501561+0000","last_unstale":"2024-09-19T08:44:19.306436+0000","last_undegraded":"2024-09-19T08:44:19.306436+0000","last_fullsized":"2024-09-19T08:44:19.306436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:30.891617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306212+0000","last_change":"2024-09-19T08:43:13.506755+0000","last_active":"2024-09-19T08:44:19.306212+0000","last_peered":"2024-09-19T08:44:19.306212+0000","last_clean":"2024-09-19T08:44:19.306212+0000","last_became_active":"2024-09-19T08:43:13.506462+0000","last_became_peered":"2024-09-19T08:43:13.506462+0000","last_unstale":"2024-09-19T08:44:19.306212+0000","last_undegraded":"2024-09-19T08:44:19.306212+0000","last_fullsized":"2024-09-19T08:44:19.306212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:37.686741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306338+0000","last_change":"2024-09-19T08:43:13.506407+0000","last_active":"2024-09-19T08:44:19.306338+0000","last_peered":"2024-09-19T08:44:19.306338+0000","last_clean":"2024-09-19T08:44:19.306338+0000","last_became_active":"2024-09-19T08:43:13.506094+0000","last_became_peered":"2024-09-19T08:43:13.506094+0000","last_unstale":"2024-09-19T08:44:19.306338+0000","last_undegraded":"2024-09-19T08:44:19.306338+0000","last_fullsized":"2024-09-19T08:44:19.306338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:40.654865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626138+0000","last_change":"2024-09-19T08:43:13.502542+0000","last_active":"2024-09-19T08:44:19.626138+0000","last_peered":"2024-09-19T08:44:19.626138+0000","last_clean":"2024-09-19T08:44:19.626138+0000","last_became_active":"2024-09-19T08:43:13.502186+0000","last_became_peered":"2024-09-19T08:43:13.502186+0000","last_unstale":"2024-09-19T08:44:19.626138+0000","last_undegraded":"2024-09-19T08:44:19.626138+0000","last_fullsized":"2024-09-19T08:44:19.626138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:18.022089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303602+0000","last_change":"2024-09-19T08:43:13.500097+0000","last_active":"2024-09-19T08:44:19.303602+0000","last_peered":"2024-09-19T08:44:19.303602+0000","last_clean":"2024-09-19T08:44:19.303602+0000","last_became_active":"2024-09-19T08:43:13.499403+0000","last_became_peered":"2024-09-19T08:43:13.499403+0000","last_unstale":"2024-09-19T08:44:19.303602+0000","last_undegraded":"2024-09-19T08:44:19.303602+0000","last_fullsized":"2024-09-19T08:44:19.303602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:29.772783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301286+0000","last_change":"2024-09-19T08:43:13.509855+0000","last_active":"2024-09-19T08:44:19.301286+0000","last_peered":"2024-09-19T08:44:19.301286+0000","last_clean":"2024-09-19T08:44:19.301286+0000","last_became_active":"2024-09-19T08:43:13.509531+0000","last_became_peered":"2024-09-19T08:43:13.509531+0000","last_unstale":"2024-09-19T08:44:19.301286+0000","last_undegraded":"2024-09-19T08:44:19.301286+0000","last_fullsized":"2024-09-19T08:44:19.301286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:47.722940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307332+0000","last_change":"2024-09-19T08:43:13.507443+0000","last_active":"2024-09-19T08:44:19.307332+0000","last_peered":"2024-09-19T08:44:19.307332+0000","last_clean":"2024-09-19T08:44:19.307332+0000","last_became_active":"2024-09-19T08:43:13.505626+0000","last_became_peered":"2024-09-19T08:43:13.505626+0000","last_unstale":"2024-09-19T08:44:19.307332+0000","last_undegraded":"2024-09-19T08:44:19.307332+0000","last_fullsized":"2024-09-19T08:44:19.307332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:27.130768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300788+0000","last_change":"2024-09-19T08:43:13.513796+0000","last_active":"2024-09-19T08:44:19.300788+0000","last_peered":"2024-09-19T08:44:19.300788+0000","last_clean":"2024-09-19T08:44:19.300788+0000","last_became_active":"2024-09-19T08:43:13.513519+0000","last_became_peered":"2024-09-19T08:43:13.513519+0000","last_unstale":"2024-09-19T08:44:19.300788+0000","last_undegraded":"2024-09-19T08:44:19.300788+0000","last_fullsized":"2024-09-19T08:44:19.300788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:32.118184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302434+0000","last_change":"2024-09-19T08:43:13.515267+0000","last_active":"2024-09-19T08:44:19.302434+0000","last_peered":"2024-09-19T08:44:19.302434+0000","last_clean":"2024-09-19T08:44:19.302434+0000","last_became_active":"2024-09-19T08:43:13.514806+0000","last_became_peered":"2024-09-19T08:43:13.514806+0000","last_unstale":"2024-09-19T08:44:19.302434+0000","last_undegraded":"2024-09-19T08:44:19.302434+0000","last_fullsized":"2024-09-19T08:44:19.302434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:10.977591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.625741+0000","last_change":"2024-09-19T08:43:13.508047+0000","last_active":"2024-09-19T08:44:19.625741+0000","last_peered":"2024-09-19T08:44:19.625741+0000","last_clean":"2024-09-19T08:44:19.625741+0000","last_became_active":"2024-09-19T08:43:13.505069+0000","last_became_peered":"2024-09-19T08:43:13.505069+0000","last_unstale":"2024-09-19T08:44:19.625741+0000","last_undegraded":"2024-09-19T08:44:19.625741+0000","last_fullsized":"2024-09-19T08:44:19.625741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.321943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304194+0000","last_change":"2024-09-19T08:43:13.510178+0000","last_active":"2024-09-19T08:44:19.304194+0000","last_peered":"2024-09-19T08:44:19.304194+0000","last_clean":"2024-09-19T08:44:19.304194+0000","last_became_active":"2024-09-19T08:43:13.509620+0000","last_became_peered":"2024-09-19T08:43:13.509620+0000","last_unstale":"2024-09-19T08:44:19.304194+0000","last_undegraded":"2024-09-19T08:44:19.304194+0000","last_fullsized":"2024-09-19T08:44:19.304194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:01.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303442+0000","last_change":"2024-09-19T08:43:13.505288+0000","last_active":"2024-09-19T08:44:19.303442+0000","last_peered":"2024-09-19T08:44:19.303442+0000","last_clean":"2024-09-19T08:44:19.303442+0000","last_became_active":"2024-09-19T08:43:13.504813+0000","last_became_peered":"2024-09-19T08:43:13.504813+0000","last_unstale":"2024-09-19T08:44:19.303442+0000","last_undegraded":"2024-09-19T08:44:19.303442+0000","last_fullsized":"2024-09-19T08:44:19.303442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:17.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303574+0000","last_change":"2024-09-19T08:43:13.508392+0000","last_active":"2024-09-19T08:44:19.303574+0000","last_peered":"2024-09-19T08:44:19.303574+0000","last_clean":"2024-09-19T08:44:19.303574+0000","last_became_active":"2024-09-19T08:43:13.507924+0000","last_became_peered":"2024-09-19T08:43:13.507924+0000","last_unstale":"2024-09-19T08:44:19.303574+0000","last_undegraded":"2024-09-19T08:44:19.303574+0000","last_fullsized":"2024-09-19T08:44:19.303574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:41.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.443149+0000","last_change":"2024-09-19T08:43:13.513906+0000","last_active":"2024-09-19T08:44:19.443149+0000","last_peered":"2024-09-19T08:44:19.443149+0000","last_clean":"2024-09-19T08:44:19.443149+0000","last_became_active":"2024-09-19T08:43:13.513570+0000","last_became_peered":"2024-09-19T08:43:13.513570+0000","last_unstale":"2024-09-19T08:44:19.443149+0000","last_undegraded":"2024-09-19T08:44:19.443149+0000","last_fullsized":"2024-09-19T08:44:19.443149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:13.516639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303877+0000","last_change":"2024-09-19T08:43:13.513776+0000","last_active":"2024-09-19T08:44:19.303877+0000","last_peered":"2024-09-19T08:44:19.303877+0000","last_clean":"2024-09-19T08:44:19.303877+0000","last_became_active":"2024-09-19T08:43:13.513087+0000","last_became_peered":"2024-09-19T08:43:13.513087+0000","last_unstale":"2024-09-19T08:44:19.303877+0000","last_undegraded":"2024-09-19T08:44:19.303877+0000","last_fullsized":"2024-09-19T08:44:19.303877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:09.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309988+0000","last_change":"2024-09-19T08:44:19.309988+0000","last_active":"2024-09-19T08:44:19.309988+0000","last_peered":"2024-09-19T08:44:19.309988+0000","last_clean":"2024-09-19T08:44:19.309988+0000","last_became_active":"2024-09-19T08:44:19.309639+0000","last_became_peered":"2024-09-19T08:44:19.309639+0000","last_unstale":"2024-09-19T08:44:19.309988+0000","last_undegraded":"2024-09-19T08:44:19.309988+0000","last_fullsized":"2024-09-19T08:44:19.309988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:04.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626625+0000","last_change":"2024-09-19T08:43:13.513825+0000","last_active":"2024-09-19T08:44:19.626625+0000","last_peered":"2024-09-19T08:44:19.626625+0000","last_clean":"2024-09-19T08:44:19.626625+0000","last_became_active":"2024-09-19T08:43:13.513458+0000","last_became_peered":"2024-09-19T08:43:13.513458+0000","last_unstale":"2024-09-19T08:44:19.626625+0000","last_undegraded":"2024-09-19T08:44:19.626625+0000","last_fullsized":"2024-09-19T08:44:19.626625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:22.141180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306378+0000","last_change":"2024-09-19T08:43:13.512512+0000","last_active":"2024-09-19T08:44:19.306378+0000","last_peered":"2024-09-19T08:44:19.306378+0000","last_clean":"2024-09-19T08:44:19.306378+0000","last_became_active":"2024-09-19T08:43:13.512117+0000","last_became_peered":"2024-09-19T08:43:13.512117+0000","last_unstale":"2024-09-19T08:44:19.306378+0000","last_undegraded":"2024-09-19T08:44:19.306378+0000","last_fullsized":"2024-09-19T08:44:19.306378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:05.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303897+0000","last_change":"2024-09-19T08:43:13.510732+0000","last_active":"2024-09-19T08:44:19.303897+0000","last_peered":"2024-09-19T08:44:19.303897+0000","last_clean":"2024-09-19T08:44:19.303897+0000","last_became_active":"2024-09-19T08:43:13.510412+0000","last_became_peered":"2024-09-19T08:43:13.510412+0000","last_unstale":"2024-09-19T08:44:19.303897+0000","last_undegraded":"2024-09-19T08:44:19.303897+0000","last_fullsized":"2024-09-19T08:44:19.303897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:32.057417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301988+0000","last_change":"2024-09-19T08:43:13.509665+0000","last_active":"2024-09-19T08:44:19.301988+0000","last_peered":"2024-09-19T08:44:19.301988+0000","last_clean":"2024-09-19T08:44:19.301988+0000","last_became_active":"2024-09-19T08:43:13.509331+0000","last_became_peered":"2024-09-19T08:43:13.509331+0000","last_unstale":"2024-09-19T08:44:19.301988+0000","last_undegraded":"2024-09-19T08:44:19.301988+0000","last_fullsized":"2024-09-19T08:44:19.301988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:18.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303042+0000","last_change":"2024-09-19T08:43:13.498969+0000","last_active":"2024-09-19T08:44:19.303042+0000","last_peered":"2024-09-19T08:44:19.303042+0000","last_clean":"2024-09-19T08:44:19.303042+0000","last_became_active":"2024-09-19T08:43:13.498274+0000","last_became_peered":"2024-09-19T08:43:13.498274+0000","last_unstale":"2024-09-19T08:44:19.303042+0000","last_undegraded":"2024-09-19T08:44:19.303042+0000","last_fullsized":"2024-09-19T08:44:19.303042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:53.220934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442931+0000","last_change":"2024-09-19T08:43:13.515101+0000","last_active":"2024-09-19T08:44:19.442931+0000","last_peered":"2024-09-19T08:44:19.442931+0000","last_clean":"2024-09-19T08:44:19.442931+0000","last_became_active":"2024-09-19T08:43:13.514476+0000","last_became_peered":"2024-09-19T08:43:13.514476+0000","last_unstale":"2024-09-19T08:44:19.442931+0000","last_undegraded":"2024-09-19T08:44:19.442931+0000","last_fullsized":"2024-09-19T08:44:19.442931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:34.864832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303939+0000","last_change":"2024-09-19T08:43:13.513978+0000","last_active":"2024-09-19T08:44:19.303939+0000","last_peered":"2024-09-19T08:44:19.303939+0000","last_clean":"2024-09-19T08:44:19.303939+0000","last_became_active":"2024-09-19T08:43:13.513644+0000","last_became_peered":"2024-09-19T08:43:13.513644+0000","last_unstale":"2024-09-19T08:44:19.303939+0000","last_undegraded":"2024-09-19T08:44:19.303939+0000","last_fullsized":"2024-09-19T08:44:19.303939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.496383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304208+0000","last_change":"2024-09-19T08:43:13.504697+0000","last_active":"2024-09-19T08:44:19.304208+0000","last_peered":"2024-09-19T08:44:19.304208+0000","last_clean":"2024-09-19T08:44:19.304208+0000","last_became_active":"2024-09-19T08:43:13.504329+0000","last_became_peered":"2024-09-19T08:43:13.504329+0000","last_unstale":"2024-09-19T08:44:19.304208+0000","last_undegraded":"2024-09-19T08:44:19.304208+0000","last_fullsized":"2024-09-19T08:44:19.304208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:54.393292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302295+0000","last_change":"2024-09-19T08:43:13.514793+0000","last_active":"2024-09-19T08:44:19.302295+0000","last_peered":"2024-09-19T08:44:19.302295+0000","last_clean":"2024-09-19T08:44:19.302295+0000","last_became_active":"2024-09-19T08:43:13.514146+0000","last_became_peered":"2024-09-19T08:43:13.514146+0000","last_unstale":"2024-09-19T08:44:19.302295+0000","last_undegraded":"2024-09-19T08:44:19.302295+0000","last_fullsized":"2024-09-19T08:44:19.302295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.616341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":118,"num_read_kb":124,"num_write":85,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":495741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36984,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708168,"statfs":{"total":95995035648,"available":95957164032,"internally_reserved":0,"allocated":1671168,"data_stored":1145718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1003520,"data_stored":500419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234031,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":495763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1090787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":991232,"data_stored":491645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1601536,"data_stored":1086291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":495763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":491749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":555190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":555738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":491735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:50.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:50.558 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:50.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:50 smithi162 ceph-mon[34870]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:50.678 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:50 smithi018 ceph-mon[30956]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:50.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:50 smithi150 ceph-mon[34610]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:51.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 -- 172.21.15.18:0/3447264441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 msgr2=0x7f8e9c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 --2- 172.21.15.18:0/3447264441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c10bb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009900 tx=0x7f8e8c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:51.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 -- 172.21.15.18:0/3447264441 shutdown_connections 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 --2- 172.21.15.18:0/3447264441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 0x7f8e9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 --2- 172.21.15.18:0/3447264441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c10bb50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 --2- 172.21.15.18:0/3447264441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e9c102d40 0x7f8e9c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 -- 172.21.15.18:0/3447264441 >> 172.21.15.18:0/3447264441 conn(0x7f8e9c0fc7a0 msgr2=0x7f8e9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 -- 172.21.15.18:0/3447264441 shutdown_connections 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.074+0000 7f8ea3385640 1 -- 172.21.15.18:0/3447264441 wait complete. 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 Processor -- start 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 -- start start 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e9c102d40 0x7f8e9c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 0x7f8e9c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c111e20 con 0x7f8e9c103660 2024-09-19T08:44:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c111ca0 con 0x7f8e9c10c170 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea3385640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c111fa0 con 0x7f8e9c102d40 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51438/0 (socket says 172.21.15.18:51438) 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 -- 172.21.15.18:0/690689946 learned_addr learned my addr 172.21.15.18:0/690689946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea1121640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e9c102d40 0x7f8e9c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea1922640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 0x7f8e9c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 -- 172.21.15.18:0/690689946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e9c102d40 msgr2=0x7f8e9c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e9c102d40 0x7f8e9c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 -- 172.21.15.18:0/690689946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 msgr2=0x7f8e9c19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 0x7f8e9c19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea0920640 1 -- 172.21.15.18:0/690689946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9c19d2b0 con 0x7f8e9c103660 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.075+0000 7f8ea1922640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 0x7f8e9c19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.076+0000 7f8ea0920640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c198840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005940 tx=0x7f8e8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.076+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c03f030 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.076+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e8c003cb0 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.076+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9c19d540 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.076+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c035070 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.076+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9c1a4e80 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.077+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9c103120 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.078+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8e8c042030 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.078+0000 7f8e927fc640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8e880a32d0 0x7f8e880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.079+0000 7f8ea1121640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8e880a32d0 0x7f8e880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.079+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f8e8c0f0620 con 0x7f8e9c103660 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.079+0000 7f8ea1121640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8e880a32d0 0x7f8e880a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800bbe0 tx=0x7f8e9800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.083+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e8c0bce80 con 0x7f8e9c103660 2024-09-19T08:44:51.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.257+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e9c062630 con 0x7f8e880a32d0 2024-09-19T08:44:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.267+0000 7f8e927fc640 1 -- 172.21.15.18:0/690689946 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340269 (secure 0 0 0) 0x7f8e9c062630 con 0x7f8e880a32d0 2024-09-19T08:44:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:51.272 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8e880a32d0 msgr2=0x7f8e880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8e880a32d0 0x7f8e880a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800bbe0 tx=0x7f8e9800b390 comp rx=0 tx=0).stop 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 msgr2=0x7f8e9c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c198840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005940 tx=0x7f8e8c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 shutdown_connections 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f8e880a32d0 0x7f8e880a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e9c10c170 0x7f8e9c19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c103660 0x7f8e9c198840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 --2- 172.21.15.18:0/690689946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e9c102d40 0x7f8e9c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 >> 172.21.15.18:0/690689946 conn(0x7f8e9c0fc7a0 msgr2=0x7f8e9c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:51.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 shutdown_connections 2024-09-19T08:44:51.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:51.271+0000 7f8ea3385640 1 -- 172.21.15.18:0/690689946 wait complete. 2024-09-19T08:44:51.647 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:51 smithi018 ceph-mon[30956]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:51.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:51 smithi162 ceph-mon[34870]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:51.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:51 smithi150 ceph-mon[34610]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:52.012 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-19T08:44:49.887160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":244,"num_read_kb":233,"num_write":268,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387948,"kb_used_data":13664,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553876,"statfs":{"total":1151940427776,"available":1151543169024,"internally_reserved":0,"allocated":13991936,"data_stored":7896539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003158"},"pg_stats":[{"pgid":"2.1f","version":"80'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.630917+0000","last_change":"2024-09-19T08:44:19.630917+0000","last_active":"2024-09-19T08:44:19.630917+0000","last_peered":"2024-09-19T08:44:19.630917+0000","last_clean":"2024-09-19T08:44:19.630917+0000","last_became_active":"2024-09-19T08:44:19.627046+0000","last_became_peered":"2024-09-19T08:44:19.627046+0000","last_unstale":"2024-09-19T08:44:19.630917+0000","last_undegraded":"2024-09-19T08:44:19.630917+0000","last_fullsized":"2024-09-19T08:44:19.630917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:51.945155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306302+0000","last_change":"2024-09-19T08:43:13.510724+0000","last_active":"2024-09-19T08:44:19.306302+0000","last_peered":"2024-09-19T08:44:19.306302+0000","last_clean":"2024-09-19T08:44:19.306302+0000","last_became_active":"2024-09-19T08:43:13.506747+0000","last_became_peered":"2024-09-19T08:43:13.506747+0000","last_unstale":"2024-09-19T08:44:19.306302+0000","last_undegraded":"2024-09-19T08:44:19.306302+0000","last_fullsized":"2024-09-19T08:44:19.306302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:07.182413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306627+0000","last_change":"2024-09-19T08:43:20.550571+0000","last_active":"2024-09-19T08:44:19.306627+0000","last_peered":"2024-09-19T08:44:19.306627+0000","last_clean":"2024-09-19T08:44:19.306627+0000","last_became_active":"2024-09-19T08:43:20.550197+0000","last_became_peered":"2024-09-19T08:43:20.550197+0000","last_unstale":"2024-09-19T08:44:19.306627+0000","last_undegraded":"2024-09-19T08:44:19.306627+0000","last_fullsized":"2024-09-19T08:44:19.306627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:52.442760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306604+0000","last_change":"2024-09-19T08:43:12.059489+0000","last_active":"2024-09-19T08:44:19.306604+0000","last_peered":"2024-09-19T08:44:19.306604+0000","last_clean":"2024-09-19T08:44:19.306604+0000","last_became_active":"2024-09-19T08:43:12.059130+0000","last_became_peered":"2024-09-19T08:43:12.059130+0000","last_unstale":"2024-09-19T08:44:19.306604+0000","last_undegraded":"2024-09-19T08:44:19.306604+0000","last_fullsized":"2024-09-19T08:44:19.306604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:09.336149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304618+0000","last_change":"2024-09-19T08:43:13.511634+0000","last_active":"2024-09-19T08:44:19.304618+0000","last_peered":"2024-09-19T08:44:19.304618+0000","last_clean":"2024-09-19T08:44:19.304618+0000","last_became_active":"2024-09-19T08:43:13.510929+0000","last_became_peered":"2024-09-19T08:43:13.510929+0000","last_unstale":"2024-09-19T08:44:19.304618+0000","last_undegraded":"2024-09-19T08:44:19.304618+0000","last_fullsized":"2024-09-19T08:44:19.304618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:30.793265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442174+0000","last_change":"2024-09-19T08:43:20.542072+0000","last_active":"2024-09-19T08:44:19.442174+0000","last_peered":"2024-09-19T08:44:19.442174+0000","last_clean":"2024-09-19T08:44:19.442174+0000","last_became_active":"2024-09-19T08:43:20.541594+0000","last_became_peered":"2024-09-19T08:43:20.541594+0000","last_unstale":"2024-09-19T08:44:19.442174+0000","last_undegraded":"2024-09-19T08:44:19.442174+0000","last_fullsized":"2024-09-19T08:44:19.442174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:03.635376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303966+0000","last_change":"2024-09-19T08:43:11.459663+0000","last_active":"2024-09-19T08:44:19.303966+0000","last_peered":"2024-09-19T08:44:19.303966+0000","last_clean":"2024-09-19T08:44:19.303966+0000","last_became_active":"2024-09-19T08:43:11.459341+0000","last_became_peered":"2024-09-19T08:43:11.459341+0000","last_unstale":"2024-09-19T08:44:19.303966+0000","last_undegraded":"2024-09-19T08:44:19.303966+0000","last_fullsized":"2024-09-19T08:44:19.303966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:55.861085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626242+0000","last_change":"2024-09-19T08:43:13.511108+0000","last_active":"2024-09-19T08:44:19.626242+0000","last_peered":"2024-09-19T08:44:19.626242+0000","last_clean":"2024-09-19T08:44:19.626242+0000","last_became_active":"2024-09-19T08:43:13.510319+0000","last_became_peered":"2024-09-19T08:43:13.510319+0000","last_unstale":"2024-09-19T08:44:19.626242+0000","last_undegraded":"2024-09-19T08:44:19.626242+0000","last_fullsized":"2024-09-19T08:44:19.626242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.119101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442789+0000","last_change":"2024-09-19T08:43:20.541003+0000","last_active":"2024-09-19T08:44:19.442789+0000","last_peered":"2024-09-19T08:44:19.442789+0000","last_clean":"2024-09-19T08:44:19.442789+0000","last_became_active":"2024-09-19T08:43:20.540597+0000","last_became_peered":"2024-09-19T08:43:20.540597+0000","last_unstale":"2024-09-19T08:44:19.442789+0000","last_undegraded":"2024-09-19T08:44:19.442789+0000","last_fullsized":"2024-09-19T08:44:19.442789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:11.553758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303924+0000","last_change":"2024-09-19T08:43:11.460680+0000","last_active":"2024-09-19T08:44:19.303924+0000","last_peered":"2024-09-19T08:44:19.303924+0000","last_clean":"2024-09-19T08:44:19.303924+0000","last_became_active":"2024-09-19T08:43:11.460335+0000","last_became_peered":"2024-09-19T08:43:11.460335+0000","last_unstale":"2024-09-19T08:44:19.303924+0000","last_undegraded":"2024-09-19T08:44:19.303924+0000","last_fullsized":"2024-09-19T08:44:19.303924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:51.332244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307144+0000","last_change":"2024-09-19T08:43:13.514161+0000","last_active":"2024-09-19T08:44:19.307144+0000","last_peered":"2024-09-19T08:44:19.307144+0000","last_clean":"2024-09-19T08:44:19.307144+0000","last_became_active":"2024-09-19T08:43:13.513674+0000","last_became_peered":"2024-09-19T08:43:13.513674+0000","last_unstale":"2024-09-19T08:44:19.307144+0000","last_undegraded":"2024-09-19T08:44:19.307144+0000","last_fullsized":"2024-09-19T08:44:19.307144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:15.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442411+0000","last_change":"2024-09-19T08:43:20.543781+0000","last_active":"2024-09-19T08:44:19.442411+0000","last_peered":"2024-09-19T08:44:19.442411+0000","last_clean":"2024-09-19T08:44:19.442411+0000","last_became_active":"2024-09-19T08:43:20.543476+0000","last_became_peered":"2024-09-19T08:43:20.543476+0000","last_unstale":"2024-09-19T08:44:19.442411+0000","last_undegraded":"2024-09-19T08:44:19.442411+0000","last_fullsized":"2024-09-19T08:44:19.442411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:27.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303371+0000","last_change":"2024-09-19T08:43:13.512711+0000","last_active":"2024-09-19T08:44:19.303371+0000","last_peered":"2024-09-19T08:44:19.303371+0000","last_clean":"2024-09-19T08:44:19.303371+0000","last_became_active":"2024-09-19T08:43:13.512406+0000","last_became_peered":"2024-09-19T08:43:13.512406+0000","last_unstale":"2024-09-19T08:44:19.303371+0000","last_undegraded":"2024-09-19T08:44:19.303371+0000","last_fullsized":"2024-09-19T08:44:19.303371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:23.765966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.446451+0000","last_change":"2024-09-19T08:44:19.446451+0000","last_active":"2024-09-19T08:44:19.446451+0000","last_peered":"2024-09-19T08:44:19.446451+0000","last_clean":"2024-09-19T08:44:19.446451+0000","last_became_active":"2024-09-19T08:44:19.443811+0000","last_became_peered":"2024-09-19T08:44:19.443811+0000","last_unstale":"2024-09-19T08:44:19.446451+0000","last_undegraded":"2024-09-19T08:44:19.446451+0000","last_fullsized":"2024-09-19T08:44:19.446451+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:38.598731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442826+0000","last_change":"2024-09-19T08:43:20.861786+0000","last_active":"2024-09-19T08:44:19.442826+0000","last_peered":"2024-09-19T08:44:19.442826+0000","last_clean":"2024-09-19T08:44:19.442826+0000","last_became_active":"2024-09-19T08:43:20.861281+0000","last_became_peered":"2024-09-19T08:43:20.861281+0000","last_unstale":"2024-09-19T08:44:19.442826+0000","last_undegraded":"2024-09-19T08:44:19.442826+0000","last_fullsized":"2024-09-19T08:44:19.442826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:47.336930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306410+0000","last_change":"2024-09-19T08:43:13.506879+0000","last_active":"2024-09-19T08:44:19.306410+0000","last_peered":"2024-09-19T08:44:19.306410+0000","last_clean":"2024-09-19T08:44:19.306410+0000","last_became_active":"2024-09-19T08:43:13.506568+0000","last_became_peered":"2024-09-19T08:43:13.506568+0000","last_unstale":"2024-09-19T08:44:19.306410+0000","last_undegraded":"2024-09-19T08:44:19.306410+0000","last_fullsized":"2024-09-19T08:44:19.306410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:50.324234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.312348+0000","last_change":"2024-09-19T08:44:19.309373+0000","last_active":"2024-09-19T08:44:19.312348+0000","last_peered":"2024-09-19T08:44:19.312348+0000","last_clean":"2024-09-19T08:44:19.312348+0000","last_became_active":"2024-09-19T08:44:19.308259+0000","last_became_peered":"2024-09-19T08:44:19.308259+0000","last_unstale":"2024-09-19T08:44:19.312348+0000","last_undegraded":"2024-09-19T08:44:19.312348+0000","last_fullsized":"2024-09-19T08:44:19.312348+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:03.311632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442745+0000","last_change":"2024-09-19T08:43:20.541453+0000","last_active":"2024-09-19T08:44:19.442745+0000","last_peered":"2024-09-19T08:44:19.442745+0000","last_clean":"2024-09-19T08:44:19.442745+0000","last_became_active":"2024-09-19T08:43:20.541014+0000","last_became_peered":"2024-09-19T08:43:20.541014+0000","last_unstale":"2024-09-19T08:44:19.442745+0000","last_undegraded":"2024-09-19T08:44:19.442745+0000","last_fullsized":"2024-09-19T08:44:19.442745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.373513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301543+0000","last_change":"2024-09-19T08:43:13.508404+0000","last_active":"2024-09-19T08:44:19.301543+0000","last_peered":"2024-09-19T08:44:19.301543+0000","last_clean":"2024-09-19T08:44:19.301543+0000","last_became_active":"2024-09-19T08:43:13.508018+0000","last_became_peered":"2024-09-19T08:43:13.508018+0000","last_unstale":"2024-09-19T08:44:19.301543+0000","last_undegraded":"2024-09-19T08:44:19.301543+0000","last_fullsized":"2024-09-19T08:44:19.301543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:43.795388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306529+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:44:19.306529+0000","last_peered":"2024-09-19T08:44:19.306529+0000","last_clean":"2024-09-19T08:44:19.306529+0000","last_became_active":"2024-09-19T08:43:11.463696+0000","last_became_peered":"2024-09-19T08:43:11.463696+0000","last_unstale":"2024-09-19T08:44:19.306529+0000","last_undegraded":"2024-09-19T08:44:19.306529+0000","last_fullsized":"2024-09-19T08:44:19.306529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:18.658727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300684+0000","last_change":"2024-09-19T08:43:20.547619+0000","last_active":"2024-09-19T08:44:19.300684+0000","last_peered":"2024-09-19T08:44:19.300684+0000","last_clean":"2024-09-19T08:44:19.300684+0000","last_became_active":"2024-09-19T08:43:20.547229+0000","last_became_peered":"2024-09-19T08:43:20.547229+0000","last_unstale":"2024-09-19T08:44:19.300684+0000","last_undegraded":"2024-09-19T08:44:19.300684+0000","last_fullsized":"2024-09-19T08:44:19.300684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:21.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303003+0000","last_change":"2024-09-19T08:43:13.501280+0000","last_active":"2024-09-19T08:44:19.303003+0000","last_peered":"2024-09-19T08:44:19.303003+0000","last_clean":"2024-09-19T08:44:19.303003+0000","last_became_active":"2024-09-19T08:43:13.500951+0000","last_became_peered":"2024-09-19T08:43:13.500951+0000","last_unstale":"2024-09-19T08:44:19.303003+0000","last_undegraded":"2024-09-19T08:44:19.303003+0000","last_fullsized":"2024-09-19T08:44:19.303003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:32.755027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.625900+0000","last_change":"2024-09-19T08:43:12.059831+0000","last_active":"2024-09-19T08:44:19.625900+0000","last_peered":"2024-09-19T08:44:19.625900+0000","last_clean":"2024-09-19T08:44:19.625900+0000","last_became_active":"2024-09-19T08:43:12.059476+0000","last_became_peered":"2024-09-19T08:43:12.059476+0000","last_unstale":"2024-09-19T08:44:19.625900+0000","last_undegraded":"2024-09-19T08:44:19.625900+0000","last_fullsized":"2024-09-19T08:44:19.625900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:07.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442965+0000","last_change":"2024-09-19T08:43:20.862549+0000","last_active":"2024-09-19T08:44:19.442965+0000","last_peered":"2024-09-19T08:44:19.442965+0000","last_clean":"2024-09-19T08:44:19.442965+0000","last_became_active":"2024-09-19T08:43:20.862132+0000","last_became_peered":"2024-09-19T08:43:20.862132+0000","last_unstale":"2024-09-19T08:44:19.442965+0000","last_undegraded":"2024-09-19T08:44:19.442965+0000","last_fullsized":"2024-09-19T08:44:19.442965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:21.979379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304563+0000","last_change":"2024-09-19T08:43:13.501448+0000","last_active":"2024-09-19T08:44:19.304563+0000","last_peered":"2024-09-19T08:44:19.304563+0000","last_clean":"2024-09-19T08:44:19.304563+0000","last_became_active":"2024-09-19T08:43:13.501037+0000","last_became_peered":"2024-09-19T08:43:13.501037+0000","last_unstale":"2024-09-19T08:44:19.304563+0000","last_undegraded":"2024-09-19T08:44:19.304563+0000","last_fullsized":"2024-09-19T08:44:19.304563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:55.190450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.443202+0000","last_change":"2024-09-19T08:43:11.512783+0000","last_active":"2024-09-19T08:44:19.443202+0000","last_peered":"2024-09-19T08:44:19.443202+0000","last_clean":"2024-09-19T08:44:19.443202+0000","last_became_active":"2024-09-19T08:43:11.512396+0000","last_became_peered":"2024-09-19T08:43:11.512396+0000","last_unstale":"2024-09-19T08:44:19.443202+0000","last_undegraded":"2024-09-19T08:44:19.443202+0000","last_fullsized":"2024-09-19T08:44:19.443202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.113193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306491+0000","last_change":"2024-09-19T08:43:20.539200+0000","last_active":"2024-09-19T08:44:19.306491+0000","last_peered":"2024-09-19T08:44:19.306491+0000","last_clean":"2024-09-19T08:44:19.306491+0000","last_became_active":"2024-09-19T08:43:20.538778+0000","last_became_peered":"2024-09-19T08:43:20.538778+0000","last_unstale":"2024-09-19T08:44:19.306491+0000","last_undegraded":"2024-09-19T08:44:19.306491+0000","last_fullsized":"2024-09-19T08:44:19.306491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:27.470045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306548+0000","last_change":"2024-09-19T08:43:13.505769+0000","last_active":"2024-09-19T08:44:19.306548+0000","last_peered":"2024-09-19T08:44:19.306548+0000","last_clean":"2024-09-19T08:44:19.306548+0000","last_became_active":"2024-09-19T08:43:13.503276+0000","last_became_peered":"2024-09-19T08:43:13.503276+0000","last_unstale":"2024-09-19T08:44:19.306548+0000","last_undegraded":"2024-09-19T08:44:19.306548+0000","last_fullsized":"2024-09-19T08:44:19.306548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:58.137325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300838+0000","last_change":"2024-09-19T08:43:11.453959+0000","last_active":"2024-09-19T08:44:19.300838+0000","last_peered":"2024-09-19T08:44:19.300838+0000","last_clean":"2024-09-19T08:44:19.300838+0000","last_became_active":"2024-09-19T08:43:11.453645+0000","last_became_peered":"2024-09-19T08:43:11.453645+0000","last_unstale":"2024-09-19T08:44:19.300838+0000","last_undegraded":"2024-09-19T08:44:19.300838+0000","last_fullsized":"2024-09-19T08:44:19.300838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:30.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306139+0000","last_change":"2024-09-19T08:43:20.861812+0000","last_active":"2024-09-19T08:44:19.306139+0000","last_peered":"2024-09-19T08:44:19.306139+0000","last_clean":"2024-09-19T08:44:19.306139+0000","last_became_active":"2024-09-19T08:43:20.861180+0000","last_became_peered":"2024-09-19T08:43:20.861180+0000","last_unstale":"2024-09-19T08:44:19.306139+0000","last_undegraded":"2024-09-19T08:44:19.306139+0000","last_fullsized":"2024-09-19T08:44:19.306139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:24.200250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303836+0000","last_change":"2024-09-19T08:43:13.500991+0000","last_active":"2024-09-19T08:44:19.303836+0000","last_peered":"2024-09-19T08:44:19.303836+0000","last_clean":"2024-09-19T08:44:19.303836+0000","last_became_active":"2024-09-19T08:43:13.500676+0000","last_became_peered":"2024-09-19T08:43:13.500676+0000","last_unstale":"2024-09-19T08:44:19.303836+0000","last_undegraded":"2024-09-19T08:44:19.303836+0000","last_fullsized":"2024-09-19T08:44:19.303836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:38.201131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304088+0000","last_change":"2024-09-19T08:43:12.059273+0000","last_active":"2024-09-19T08:44:19.304088+0000","last_peered":"2024-09-19T08:44:19.304088+0000","last_clean":"2024-09-19T08:44:19.304088+0000","last_became_active":"2024-09-19T08:43:12.058873+0000","last_became_peered":"2024-09-19T08:43:12.058873+0000","last_unstale":"2024-09-19T08:44:19.304088+0000","last_undegraded":"2024-09-19T08:44:19.304088+0000","last_fullsized":"2024-09-19T08:44:19.304088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:43.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301279+0000","last_change":"2024-09-19T08:43:20.543459+0000","last_active":"2024-09-19T08:44:19.301279+0000","last_peered":"2024-09-19T08:44:19.301279+0000","last_clean":"2024-09-19T08:44:19.301279+0000","last_became_active":"2024-09-19T08:43:20.542946+0000","last_became_peered":"2024-09-19T08:43:20.542946+0000","last_unstale":"2024-09-19T08:44:19.301279+0000","last_undegraded":"2024-09-19T08:44:19.301279+0000","last_fullsized":"2024-09-19T08:44:19.301279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:19.423576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302032+0000","last_change":"2024-09-19T08:43:13.506844+0000","last_active":"2024-09-19T08:44:19.302032+0000","last_peered":"2024-09-19T08:44:19.302032+0000","last_clean":"2024-09-19T08:44:19.302032+0000","last_became_active":"2024-09-19T08:43:13.506495+0000","last_became_peered":"2024-09-19T08:43:13.506495+0000","last_unstale":"2024-09-19T08:44:19.302032+0000","last_undegraded":"2024-09-19T08:44:19.302032+0000","last_fullsized":"2024-09-19T08:44:19.302032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:59.058100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300645+0000","last_change":"2024-09-19T08:43:12.060835+0000","last_active":"2024-09-19T08:44:19.300645+0000","last_peered":"2024-09-19T08:44:19.300645+0000","last_clean":"2024-09-19T08:44:19.300645+0000","last_became_active":"2024-09-19T08:43:12.060376+0000","last_became_peered":"2024-09-19T08:43:12.060376+0000","last_unstale":"2024-09-19T08:44:19.300645+0000","last_undegraded":"2024-09-19T08:44:19.300645+0000","last_fullsized":"2024-09-19T08:44:19.300645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:38.385378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303043+0000","last_change":"2024-09-19T08:43:20.861704+0000","last_active":"2024-09-19T08:44:19.303043+0000","last_peered":"2024-09-19T08:44:19.303043+0000","last_clean":"2024-09-19T08:44:19.303043+0000","last_became_active":"2024-09-19T08:43:20.861209+0000","last_became_peered":"2024-09-19T08:43:20.861209+0000","last_unstale":"2024-09-19T08:44:19.303043+0000","last_undegraded":"2024-09-19T08:44:19.303043+0000","last_fullsized":"2024-09-19T08:44:19.303043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:02.717283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302268+0000","last_change":"2024-09-19T08:43:13.506167+0000","last_active":"2024-09-19T08:44:19.302268+0000","last_peered":"2024-09-19T08:44:19.302268+0000","last_clean":"2024-09-19T08:44:19.302268+0000","last_became_active":"2024-09-19T08:43:13.505771+0000","last_became_peered":"2024-09-19T08:43:13.505771+0000","last_unstale":"2024-09-19T08:44:19.302268+0000","last_undegraded":"2024-09-19T08:44:19.302268+0000","last_fullsized":"2024-09-19T08:44:19.302268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:10.408410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303466+0000","last_change":"2024-09-19T08:43:11.461464+0000","last_active":"2024-09-19T08:44:19.303466+0000","last_peered":"2024-09-19T08:44:19.303466+0000","last_clean":"2024-09-19T08:44:19.303466+0000","last_became_active":"2024-09-19T08:43:11.461109+0000","last_became_peered":"2024-09-19T08:43:11.461109+0000","last_unstale":"2024-09-19T08:44:19.303466+0000","last_undegraded":"2024-09-19T08:44:19.303466+0000","last_fullsized":"2024-09-19T08:44:19.303466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:43.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303589+0000","last_change":"2024-09-19T08:43:20.539703+0000","last_active":"2024-09-19T08:44:19.303589+0000","last_peered":"2024-09-19T08:44:19.303589+0000","last_clean":"2024-09-19T08:44:19.303589+0000","last_became_active":"2024-09-19T08:43:20.538601+0000","last_became_peered":"2024-09-19T08:43:20.538601+0000","last_unstale":"2024-09-19T08:44:19.303589+0000","last_undegraded":"2024-09-19T08:44:19.303589+0000","last_fullsized":"2024-09-19T08:44:19.303589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:09.306293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306317+0000","last_change":"2024-09-19T08:43:13.511861+0000","last_active":"2024-09-19T08:44:19.306317+0000","last_peered":"2024-09-19T08:44:19.306317+0000","last_clean":"2024-09-19T08:44:19.306317+0000","last_became_active":"2024-09-19T08:43:13.511426+0000","last_became_peered":"2024-09-19T08:43:13.511426+0000","last_unstale":"2024-09-19T08:44:19.306317+0000","last_undegraded":"2024-09-19T08:44:19.306317+0000","last_fullsized":"2024-09-19T08:44:19.306317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:06.975135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303300+0000","last_change":"2024-09-19T08:43:12.059704+0000","last_active":"2024-09-19T08:44:19.303300+0000","last_peered":"2024-09-19T08:44:19.303300+0000","last_clean":"2024-09-19T08:44:19.303300+0000","last_became_active":"2024-09-19T08:43:12.059338+0000","last_became_peered":"2024-09-19T08:43:12.059338+0000","last_unstale":"2024-09-19T08:44:19.303300+0000","last_undegraded":"2024-09-19T08:44:19.303300+0000","last_fullsized":"2024-09-19T08:44:19.303300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:03.336909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303841+0000","last_change":"2024-09-19T08:43:20.861308+0000","last_active":"2024-09-19T08:44:19.303841+0000","last_peered":"2024-09-19T08:44:19.303841+0000","last_clean":"2024-09-19T08:44:19.303841+0000","last_became_active":"2024-09-19T08:43:20.860901+0000","last_became_peered":"2024-09-19T08:43:20.860901+0000","last_unstale":"2024-09-19T08:44:19.303841+0000","last_undegraded":"2024-09-19T08:44:19.303841+0000","last_fullsized":"2024-09-19T08:44:19.303841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:15.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303079+0000","last_change":"2024-09-19T08:43:13.501723+0000","last_active":"2024-09-19T08:44:19.303079+0000","last_peered":"2024-09-19T08:44:19.303079+0000","last_clean":"2024-09-19T08:44:19.303079+0000","last_became_active":"2024-09-19T08:43:13.501427+0000","last_became_peered":"2024-09-19T08:43:13.501427+0000","last_unstale":"2024-09-19T08:44:19.303079+0000","last_undegraded":"2024-09-19T08:44:19.303079+0000","last_fullsized":"2024-09-19T08:44:19.303079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:26.870460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.312475+0000","last_change":"2024-09-19T08:44:19.310765+0000","last_active":"2024-09-19T08:44:19.312475+0000","last_peered":"2024-09-19T08:44:19.312475+0000","last_clean":"2024-09-19T08:44:19.312475+0000","last_became_active":"2024-09-19T08:44:19.310370+0000","last_became_peered":"2024-09-19T08:44:19.310370+0000","last_unstale":"2024-09-19T08:44:19.312475+0000","last_undegraded":"2024-09-19T08:44:19.312475+0000","last_fullsized":"2024-09-19T08:44:19.312475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:33.759809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305851+0000","last_change":"2024-09-19T08:43:20.862595+0000","last_active":"2024-09-19T08:44:19.305851+0000","last_peered":"2024-09-19T08:44:19.305851+0000","last_clean":"2024-09-19T08:44:19.305851+0000","last_became_active":"2024-09-19T08:43:20.862143+0000","last_became_peered":"2024-09-19T08:43:20.862143+0000","last_unstale":"2024-09-19T08:44:19.305851+0000","last_undegraded":"2024-09-19T08:44:19.305851+0000","last_fullsized":"2024-09-19T08:44:19.305851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.653517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306503+0000","last_change":"2024-09-19T08:43:13.513129+0000","last_active":"2024-09-19T08:44:19.306503+0000","last_peered":"2024-09-19T08:44:19.306503+0000","last_clean":"2024-09-19T08:44:19.306503+0000","last_became_active":"2024-09-19T08:43:13.512681+0000","last_became_peered":"2024-09-19T08:43:13.512681+0000","last_unstale":"2024-09-19T08:44:19.306503+0000","last_undegraded":"2024-09-19T08:44:19.306503+0000","last_fullsized":"2024-09-19T08:44:19.306503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:50.057369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.443130+0000","last_change":"2024-09-19T08:43:11.461772+0000","last_active":"2024-09-19T08:44:19.443130+0000","last_peered":"2024-09-19T08:44:19.443130+0000","last_clean":"2024-09-19T08:44:19.443130+0000","last_became_active":"2024-09-19T08:43:11.461066+0000","last_became_peered":"2024-09-19T08:43:11.461066+0000","last_unstale":"2024-09-19T08:44:19.443130+0000","last_undegraded":"2024-09-19T08:44:19.443130+0000","last_fullsized":"2024-09-19T08:44:19.443130+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:55.360550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303377+0000","last_change":"2024-09-19T08:41:59.671692+0000","last_active":"2024-09-19T08:44:19.303377+0000","last_peered":"2024-09-19T08:44:19.303377+0000","last_clean":"2024-09-19T08:44:19.303377+0000","last_became_active":"2024-09-19T08:41:59.671224+0000","last_became_peered":"2024-09-19T08:41:59.671224+0000","last_unstale":"2024-09-19T08:44:19.303377+0000","last_undegraded":"2024-09-19T08:44:19.303377+0000","last_fullsized":"2024-09-19T08:44:19.303377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:34.722787+0000","last_clean_scrub_stamp":"2024-09-19T08:38:34.722787+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:50.768501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303773+0000","last_change":"2024-09-19T08:43:20.545612+0000","last_active":"2024-09-19T08:44:19.303773+0000","last_peered":"2024-09-19T08:44:19.303773+0000","last_clean":"2024-09-19T08:44:19.303773+0000","last_became_active":"2024-09-19T08:43:20.545236+0000","last_became_peered":"2024-09-19T08:43:20.545236+0000","last_unstale":"2024-09-19T08:44:19.303773+0000","last_undegraded":"2024-09-19T08:44:19.303773+0000","last_fullsized":"2024-09-19T08:44:19.303773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:53.972567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303961+0000","last_change":"2024-09-19T08:43:13.514014+0000","last_active":"2024-09-19T08:44:19.303961+0000","last_peered":"2024-09-19T08:44:19.303961+0000","last_clean":"2024-09-19T08:44:19.303961+0000","last_became_active":"2024-09-19T08:43:13.513492+0000","last_became_peered":"2024-09-19T08:43:13.513492+0000","last_unstale":"2024-09-19T08:44:19.303961+0000","last_undegraded":"2024-09-19T08:44:19.303961+0000","last_fullsized":"2024-09-19T08:44:19.303961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:17.914628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307582+0000","last_change":"2024-09-19T08:43:12.059822+0000","last_active":"2024-09-19T08:44:19.307582+0000","last_peered":"2024-09-19T08:44:19.307582+0000","last_clean":"2024-09-19T08:44:19.307582+0000","last_became_active":"2024-09-19T08:43:12.059469+0000","last_became_peered":"2024-09-19T08:43:12.059469+0000","last_unstale":"2024-09-19T08:44:19.307582+0000","last_undegraded":"2024-09-19T08:44:19.307582+0000","last_fullsized":"2024-09-19T08:44:19.307582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:22.283239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.625985+0000","last_change":"2024-09-19T08:43:20.533058+0000","last_active":"2024-09-19T08:44:19.625985+0000","last_peered":"2024-09-19T08:44:19.625985+0000","last_clean":"2024-09-19T08:44:19.625985+0000","last_became_active":"2024-09-19T08:43:20.532573+0000","last_became_peered":"2024-09-19T08:43:20.532573+0000","last_unstale":"2024-09-19T08:44:19.625985+0000","last_undegraded":"2024-09-19T08:44:19.625985+0000","last_fullsized":"2024-09-19T08:44:19.625985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:30.449747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309383+0000","last_change":"2024-09-19T08:44:19.309383+0000","last_active":"2024-09-19T08:44:19.309383+0000","last_peered":"2024-09-19T08:44:19.309383+0000","last_clean":"2024-09-19T08:44:19.309383+0000","last_became_active":"2024-09-19T08:44:19.309043+0000","last_became_peered":"2024-09-19T08:44:19.309043+0000","last_unstale":"2024-09-19T08:44:19.309383+0000","last_undegraded":"2024-09-19T08:44:19.309383+0000","last_fullsized":"2024-09-19T08:44:19.309383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:20.096915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307406+0000","last_change":"2024-09-19T08:43:11.461700+0000","last_active":"2024-09-19T08:44:19.307406+0000","last_peered":"2024-09-19T08:44:19.307406+0000","last_clean":"2024-09-19T08:44:19.307406+0000","last_became_active":"2024-09-19T08:43:11.461340+0000","last_became_peered":"2024-09-19T08:43:11.461340+0000","last_unstale":"2024-09-19T08:44:19.307406+0000","last_undegraded":"2024-09-19T08:44:19.307406+0000","last_fullsized":"2024-09-19T08:44:19.307406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:00.331483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304515+0000","last_change":"2024-09-19T08:43:20.541431+0000","last_active":"2024-09-19T08:44:19.304515+0000","last_peered":"2024-09-19T08:44:19.304515+0000","last_clean":"2024-09-19T08:44:19.304515+0000","last_became_active":"2024-09-19T08:43:20.540990+0000","last_became_peered":"2024-09-19T08:43:20.540990+0000","last_unstale":"2024-09-19T08:44:19.304515+0000","last_undegraded":"2024-09-19T08:44:19.304515+0000","last_fullsized":"2024-09-19T08:44:19.304515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:45.733086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303949+0000","last_change":"2024-09-19T08:43:13.505948+0000","last_active":"2024-09-19T08:44:19.303949+0000","last_peered":"2024-09-19T08:44:19.303949+0000","last_clean":"2024-09-19T08:44:19.303949+0000","last_became_active":"2024-09-19T08:43:13.505600+0000","last_became_peered":"2024-09-19T08:43:13.505600+0000","last_unstale":"2024-09-19T08:44:19.303949+0000","last_undegraded":"2024-09-19T08:44:19.303949+0000","last_fullsized":"2024-09-19T08:44:19.303949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:06.461033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.448125+0000","last_change":"2024-09-19T08:44:19.448125+0000","last_active":"2024-09-19T08:44:19.448125+0000","last_peered":"2024-09-19T08:44:19.448125+0000","last_clean":"2024-09-19T08:44:19.448125+0000","last_became_active":"2024-09-19T08:44:19.444107+0000","last_became_peered":"2024-09-19T08:44:19.444107+0000","last_unstale":"2024-09-19T08:44:19.448125+0000","last_undegraded":"2024-09-19T08:44:19.448125+0000","last_fullsized":"2024-09-19T08:44:19.448125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:53.979830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305794+0000","last_change":"2024-09-19T08:43:20.539563+0000","last_active":"2024-09-19T08:44:19.305794+0000","last_peered":"2024-09-19T08:44:19.305794+0000","last_clean":"2024-09-19T08:44:19.305794+0000","last_became_active":"2024-09-19T08:43:20.539164+0000","last_became_peered":"2024-09-19T08:43:20.539164+0000","last_unstale":"2024-09-19T08:44:19.305794+0000","last_undegraded":"2024-09-19T08:44:19.305794+0000","last_fullsized":"2024-09-19T08:44:19.305794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:06.285326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301905+0000","last_change":"2024-09-19T08:43:13.513618+0000","last_active":"2024-09-19T08:44:19.301905+0000","last_peered":"2024-09-19T08:44:19.301905+0000","last_clean":"2024-09-19T08:44:19.301905+0000","last_became_active":"2024-09-19T08:43:13.513281+0000","last_became_peered":"2024-09-19T08:43:13.513281+0000","last_unstale":"2024-09-19T08:44:19.301905+0000","last_undegraded":"2024-09-19T08:44:19.301905+0000","last_fullsized":"2024-09-19T08:44:19.301905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:40.874071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303818+0000","last_change":"2024-09-19T08:43:11.457087+0000","last_active":"2024-09-19T08:44:19.303818+0000","last_peered":"2024-09-19T08:44:19.303818+0000","last_clean":"2024-09-19T08:44:19.303818+0000","last_became_active":"2024-09-19T08:43:11.456687+0000","last_became_peered":"2024-09-19T08:43:11.456687+0000","last_unstale":"2024-09-19T08:44:19.303818+0000","last_undegraded":"2024-09-19T08:44:19.303818+0000","last_fullsized":"2024-09-19T08:44:19.303818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:40.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305287+0000","last_change":"2024-09-19T08:43:20.540740+0000","last_active":"2024-09-19T08:44:19.305287+0000","last_peered":"2024-09-19T08:44:19.305287+0000","last_clean":"2024-09-19T08:44:19.305287+0000","last_became_active":"2024-09-19T08:43:20.540044+0000","last_became_peered":"2024-09-19T08:43:20.540044+0000","last_unstale":"2024-09-19T08:44:19.305287+0000","last_undegraded":"2024-09-19T08:44:19.305287+0000","last_fullsized":"2024-09-19T08:44:19.305287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:11.238259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.305492+0000","last_change":"2024-09-19T08:43:13.514193+0000","last_active":"2024-09-19T08:44:19.305492+0000","last_peered":"2024-09-19T08:44:19.305492+0000","last_clean":"2024-09-19T08:44:19.305492+0000","last_became_active":"2024-09-19T08:43:13.513864+0000","last_became_peered":"2024-09-19T08:43:13.513864+0000","last_unstale":"2024-09-19T08:44:19.305492+0000","last_undegraded":"2024-09-19T08:44:19.305492+0000","last_fullsized":"2024-09-19T08:44:19.305492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:15.575162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304300+0000","last_change":"2024-09-19T08:43:12.059836+0000","last_active":"2024-09-19T08:44:19.304300+0000","last_peered":"2024-09-19T08:44:19.304300+0000","last_clean":"2024-09-19T08:44:19.304300+0000","last_became_active":"2024-09-19T08:43:12.059459+0000","last_became_peered":"2024-09-19T08:43:12.059459+0000","last_unstale":"2024-09-19T08:44:19.304300+0000","last_undegraded":"2024-09-19T08:44:19.304300+0000","last_fullsized":"2024-09-19T08:44:19.304300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:53.932649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304002+0000","last_change":"2024-09-19T08:43:20.540919+0000","last_active":"2024-09-19T08:44:19.304002+0000","last_peered":"2024-09-19T08:44:19.304002+0000","last_clean":"2024-09-19T08:44:19.304002+0000","last_became_active":"2024-09-19T08:43:20.540535+0000","last_became_peered":"2024-09-19T08:43:20.540535+0000","last_unstale":"2024-09-19T08:44:19.304002+0000","last_undegraded":"2024-09-19T08:44:19.304002+0000","last_fullsized":"2024-09-19T08:44:19.304002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:32.767025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302938+0000","last_change":"2024-09-19T08:43:13.511693+0000","last_active":"2024-09-19T08:44:19.302938+0000","last_peered":"2024-09-19T08:44:19.302938+0000","last_clean":"2024-09-19T08:44:19.302938+0000","last_became_active":"2024-09-19T08:43:13.511347+0000","last_became_peered":"2024-09-19T08:43:13.511347+0000","last_unstale":"2024-09-19T08:44:19.302938+0000","last_undegraded":"2024-09-19T08:44:19.302938+0000","last_fullsized":"2024-09-19T08:44:19.302938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:22.146900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442626+0000","last_change":"2024-09-19T08:43:11.461514+0000","last_active":"2024-09-19T08:44:19.442626+0000","last_peered":"2024-09-19T08:44:19.442626+0000","last_clean":"2024-09-19T08:44:19.442626+0000","last_became_active":"2024-09-19T08:43:11.461079+0000","last_became_peered":"2024-09-19T08:43:11.461079+0000","last_unstale":"2024-09-19T08:44:19.442626+0000","last_undegraded":"2024-09-19T08:44:19.442626+0000","last_fullsized":"2024-09-19T08:44:19.442626+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:10.978243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300766+0000","last_change":"2024-09-19T08:43:20.546834+0000","last_active":"2024-09-19T08:44:19.300766+0000","last_peered":"2024-09-19T08:44:19.300766+0000","last_clean":"2024-09-19T08:44:19.300766+0000","last_became_active":"2024-09-19T08:43:20.545732+0000","last_became_peered":"2024-09-19T08:43:20.545732+0000","last_unstale":"2024-09-19T08:44:19.300766+0000","last_undegraded":"2024-09-19T08:44:19.300766+0000","last_fullsized":"2024-09-19T08:44:19.300766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:56.570928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303214+0000","last_change":"2024-09-19T08:43:13.508295+0000","last_active":"2024-09-19T08:44:19.303214+0000","last_peered":"2024-09-19T08:44:19.303214+0000","last_clean":"2024-09-19T08:44:19.303214+0000","last_became_active":"2024-09-19T08:43:13.507988+0000","last_became_peered":"2024-09-19T08:43:13.507988+0000","last_unstale":"2024-09-19T08:44:19.303214+0000","last_undegraded":"2024-09-19T08:44:19.303214+0000","last_fullsized":"2024-09-19T08:44:19.303214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:33.473262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306486+0000","last_change":"2024-09-19T08:43:11.457965+0000","last_active":"2024-09-19T08:44:19.306486+0000","last_peered":"2024-09-19T08:44:19.306486+0000","last_clean":"2024-09-19T08:44:19.306486+0000","last_became_active":"2024-09-19T08:43:11.456616+0000","last_became_peered":"2024-09-19T08:43:11.456616+0000","last_unstale":"2024-09-19T08:44:19.306486+0000","last_undegraded":"2024-09-19T08:44:19.306486+0000","last_fullsized":"2024-09-19T08:44:19.306486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:17.635896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301235+0000","last_change":"2024-09-19T08:43:20.546848+0000","last_active":"2024-09-19T08:44:19.301235+0000","last_peered":"2024-09-19T08:44:19.301235+0000","last_clean":"2024-09-19T08:44:19.301235+0000","last_became_active":"2024-09-19T08:43:20.546430+0000","last_became_peered":"2024-09-19T08:43:20.546430+0000","last_unstale":"2024-09-19T08:44:19.301235+0000","last_undegraded":"2024-09-19T08:44:19.301235+0000","last_fullsized":"2024-09-19T08:44:19.301235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:39.031339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303948+0000","last_change":"2024-09-19T08:43:13.499817+0000","last_active":"2024-09-19T08:44:19.303948+0000","last_peered":"2024-09-19T08:44:19.303948+0000","last_clean":"2024-09-19T08:44:19.303948+0000","last_became_active":"2024-09-19T08:43:13.499446+0000","last_became_peered":"2024-09-19T08:43:13.499446+0000","last_unstale":"2024-09-19T08:44:19.303948+0000","last_undegraded":"2024-09-19T08:44:19.303948+0000","last_fullsized":"2024-09-19T08:44:19.303948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:04.093262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.308275+0000","last_change":"2024-09-19T08:43:11.464099+0000","last_active":"2024-09-19T08:44:19.308275+0000","last_peered":"2024-09-19T08:44:19.308275+0000","last_clean":"2024-09-19T08:44:19.308275+0000","last_became_active":"2024-09-19T08:43:11.463735+0000","last_became_peered":"2024-09-19T08:43:11.463735+0000","last_unstale":"2024-09-19T08:44:19.308275+0000","last_undegraded":"2024-09-19T08:44:19.308275+0000","last_fullsized":"2024-09-19T08:44:19.308275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:10.951239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307031+0000","last_change":"2024-09-19T08:43:20.537810+0000","last_active":"2024-09-19T08:44:19.307031+0000","last_peered":"2024-09-19T08:44:19.307031+0000","last_clean":"2024-09-19T08:44:19.307031+0000","last_became_active":"2024-09-19T08:43:20.537355+0000","last_became_peered":"2024-09-19T08:43:20.537355+0000","last_unstale":"2024-09-19T08:44:19.307031+0000","last_undegraded":"2024-09-19T08:44:19.307031+0000","last_fullsized":"2024-09-19T08:44:19.307031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:55.767023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303733+0000","last_change":"2024-09-19T08:43:13.502536+0000","last_active":"2024-09-19T08:44:19.303733+0000","last_peered":"2024-09-19T08:44:19.303733+0000","last_clean":"2024-09-19T08:44:19.303733+0000","last_became_active":"2024-09-19T08:43:13.500808+0000","last_became_peered":"2024-09-19T08:43:13.500808+0000","last_unstale":"2024-09-19T08:44:19.303733+0000","last_undegraded":"2024-09-19T08:44:19.303733+0000","last_fullsized":"2024-09-19T08:44:19.303733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:51.902896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":176,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:45.725991+0000","last_change":"2024-09-19T08:43:11.464120+0000","last_active":"2024-09-19T08:44:45.725991+0000","last_peered":"2024-09-19T08:44:45.725991+0000","last_clean":"2024-09-19T08:44:45.725991+0000","last_became_active":"2024-09-19T08:43:11.463756+0000","last_became_peered":"2024-09-19T08:43:11.463756+0000","last_unstale":"2024-09-19T08:44:45.725991+0000","last_undegraded":"2024-09-19T08:44:45.725991+0000","last_fullsized":"2024-09-19T08:44:45.725991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:39.124949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":118,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300389+0000","last_change":"2024-09-19T08:43:20.546900+0000","last_active":"2024-09-19T08:44:19.300389+0000","last_peered":"2024-09-19T08:44:19.300389+0000","last_clean":"2024-09-19T08:44:19.300389+0000","last_became_active":"2024-09-19T08:43:20.545914+0000","last_became_peered":"2024-09-19T08:43:20.545914+0000","last_unstale":"2024-09-19T08:44:19.300389+0000","last_undegraded":"2024-09-19T08:44:19.300389+0000","last_fullsized":"2024-09-19T08:44:19.300389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:02.842999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626268+0000","last_change":"2024-09-19T08:43:13.510848+0000","last_active":"2024-09-19T08:44:19.626268+0000","last_peered":"2024-09-19T08:44:19.626268+0000","last_clean":"2024-09-19T08:44:19.626268+0000","last_became_active":"2024-09-19T08:43:13.510224+0000","last_became_peered":"2024-09-19T08:43:13.510224+0000","last_unstale":"2024-09-19T08:44:19.626268+0000","last_undegraded":"2024-09-19T08:44:19.626268+0000","last_fullsized":"2024-09-19T08:44:19.626268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:56.113933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307304+0000","last_change":"2024-09-19T08:43:12.061493+0000","last_active":"2024-09-19T08:44:19.307304+0000","last_peered":"2024-09-19T08:44:19.307304+0000","last_clean":"2024-09-19T08:44:19.307304+0000","last_became_active":"2024-09-19T08:43:12.061157+0000","last_became_peered":"2024-09-19T08:43:12.061157+0000","last_unstale":"2024-09-19T08:44:19.307304+0000","last_undegraded":"2024-09-19T08:44:19.307304+0000","last_fullsized":"2024-09-19T08:44:19.307304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:59.542997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442683+0000","last_change":"2024-09-19T08:43:20.546703+0000","last_active":"2024-09-19T08:44:19.442683+0000","last_peered":"2024-09-19T08:44:19.442683+0000","last_clean":"2024-09-19T08:44:19.442683+0000","last_became_active":"2024-09-19T08:43:20.546247+0000","last_became_peered":"2024-09-19T08:43:20.546247+0000","last_unstale":"2024-09-19T08:44:19.442683+0000","last_undegraded":"2024-09-19T08:44:19.442683+0000","last_fullsized":"2024-09-19T08:44:19.442683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:53.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309808+0000","last_change":"2024-09-19T08:44:19.309808+0000","last_active":"2024-09-19T08:44:19.309808+0000","last_peered":"2024-09-19T08:44:19.309808+0000","last_clean":"2024-09-19T08:44:19.309808+0000","last_became_active":"2024-09-19T08:44:19.309286+0000","last_became_peered":"2024-09-19T08:44:19.309286+0000","last_unstale":"2024-09-19T08:44:19.309808+0000","last_undegraded":"2024-09-19T08:44:19.309808+0000","last_fullsized":"2024-09-19T08:44:19.309808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:28.825203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303775+0000","last_change":"2024-09-19T08:43:11.460928+0000","last_active":"2024-09-19T08:44:19.303775+0000","last_peered":"2024-09-19T08:44:19.303775+0000","last_clean":"2024-09-19T08:44:19.303775+0000","last_became_active":"2024-09-19T08:43:11.460555+0000","last_became_peered":"2024-09-19T08:43:11.460555+0000","last_unstale":"2024-09-19T08:44:19.303775+0000","last_undegraded":"2024-09-19T08:44:19.303775+0000","last_fullsized":"2024-09-19T08:44:19.303775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:21.671235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300222+0000","last_change":"2024-09-19T08:43:20.547775+0000","last_active":"2024-09-19T08:44:19.300222+0000","last_peered":"2024-09-19T08:44:19.300222+0000","last_clean":"2024-09-19T08:44:19.300222+0000","last_became_active":"2024-09-19T08:43:20.547318+0000","last_became_peered":"2024-09-19T08:43:20.547318+0000","last_unstale":"2024-09-19T08:44:19.300222+0000","last_undegraded":"2024-09-19T08:44:19.300222+0000","last_fullsized":"2024-09-19T08:44:19.300222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:14.925314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626622+0000","last_change":"2024-09-19T08:43:13.511510+0000","last_active":"2024-09-19T08:44:19.626622+0000","last_peered":"2024-09-19T08:44:19.626622+0000","last_clean":"2024-09-19T08:44:19.626622+0000","last_became_active":"2024-09-19T08:43:13.511184+0000","last_became_peered":"2024-09-19T08:43:13.511184+0000","last_unstale":"2024-09-19T08:44:19.626622+0000","last_undegraded":"2024-09-19T08:44:19.626622+0000","last_fullsized":"2024-09-19T08:44:19.626622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:23.864506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302187+0000","last_change":"2024-09-19T08:43:11.460981+0000","last_active":"2024-09-19T08:44:19.302187+0000","last_peered":"2024-09-19T08:44:19.302187+0000","last_clean":"2024-09-19T08:44:19.302187+0000","last_became_active":"2024-09-19T08:43:11.460484+0000","last_became_peered":"2024-09-19T08:43:11.460484+0000","last_unstale":"2024-09-19T08:44:19.302187+0000","last_undegraded":"2024-09-19T08:44:19.302187+0000","last_fullsized":"2024-09-19T08:44:19.302187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:35.952469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306683+0000","last_change":"2024-09-19T08:43:20.544626+0000","last_active":"2024-09-19T08:44:19.306683+0000","last_peered":"2024-09-19T08:44:19.306683+0000","last_clean":"2024-09-19T08:44:19.306683+0000","last_became_active":"2024-09-19T08:43:20.543836+0000","last_became_peered":"2024-09-19T08:43:20.543836+0000","last_unstale":"2024-09-19T08:44:19.306683+0000","last_undegraded":"2024-09-19T08:44:19.306683+0000","last_fullsized":"2024-09-19T08:44:19.306683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:17.508084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304303+0000","last_change":"2024-09-19T08:43:20.539467+0000","last_active":"2024-09-19T08:44:19.304303+0000","last_peered":"2024-09-19T08:44:19.304303+0000","last_clean":"2024-09-19T08:44:19.304303+0000","last_became_active":"2024-09-19T08:43:20.539077+0000","last_became_peered":"2024-09-19T08:43:20.539077+0000","last_unstale":"2024-09-19T08:44:19.304303+0000","last_undegraded":"2024-09-19T08:44:19.304303+0000","last_fullsized":"2024-09-19T08:44:19.304303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:10.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300847+0000","last_change":"2024-09-19T08:43:13.505261+0000","last_active":"2024-09-19T08:44:19.300847+0000","last_peered":"2024-09-19T08:44:19.300847+0000","last_clean":"2024-09-19T08:44:19.300847+0000","last_became_active":"2024-09-19T08:43:13.504984+0000","last_became_peered":"2024-09-19T08:43:13.504984+0000","last_unstale":"2024-09-19T08:44:19.300847+0000","last_undegraded":"2024-09-19T08:44:19.300847+0000","last_fullsized":"2024-09-19T08:44:19.300847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:34.074003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306434+0000","last_change":"2024-09-19T08:43:11.457207+0000","last_active":"2024-09-19T08:44:19.306434+0000","last_peered":"2024-09-19T08:44:19.306434+0000","last_clean":"2024-09-19T08:44:19.306434+0000","last_became_active":"2024-09-19T08:43:11.456827+0000","last_became_peered":"2024-09-19T08:43:11.456827+0000","last_unstale":"2024-09-19T08:44:19.306434+0000","last_undegraded":"2024-09-19T08:44:19.306434+0000","last_fullsized":"2024-09-19T08:44:19.306434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:51.552985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301523+0000","last_change":"2024-09-19T08:43:20.547563+0000","last_active":"2024-09-19T08:44:19.301523+0000","last_peered":"2024-09-19T08:44:19.301523+0000","last_clean":"2024-09-19T08:44:19.301523+0000","last_became_active":"2024-09-19T08:43:20.546909+0000","last_became_peered":"2024-09-19T08:43:20.546909+0000","last_unstale":"2024-09-19T08:44:19.301523+0000","last_undegraded":"2024-09-19T08:44:19.301523+0000","last_fullsized":"2024-09-19T08:44:19.301523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:22.616336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306936+0000","last_change":"2024-09-19T08:43:13.498744+0000","last_active":"2024-09-19T08:44:19.306936+0000","last_peered":"2024-09-19T08:44:19.306936+0000","last_clean":"2024-09-19T08:44:19.306936+0000","last_became_active":"2024-09-19T08:43:13.498459+0000","last_became_peered":"2024-09-19T08:43:13.498459+0000","last_unstale":"2024-09-19T08:44:19.306936+0000","last_undegraded":"2024-09-19T08:44:19.306936+0000","last_fullsized":"2024-09-19T08:44:19.306936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:55.743244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303192+0000","last_change":"2024-09-19T08:43:11.455855+0000","last_active":"2024-09-19T08:44:19.303192+0000","last_peered":"2024-09-19T08:44:19.303192+0000","last_clean":"2024-09-19T08:44:19.303192+0000","last_became_active":"2024-09-19T08:43:11.455450+0000","last_became_peered":"2024-09-19T08:43:11.455450+0000","last_unstale":"2024-09-19T08:44:19.303192+0000","last_undegraded":"2024-09-19T08:44:19.303192+0000","last_fullsized":"2024-09-19T08:44:19.303192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:45.223953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302058+0000","last_change":"2024-09-19T08:43:11.462187+0000","last_active":"2024-09-19T08:44:19.302058+0000","last_peered":"2024-09-19T08:44:19.302058+0000","last_clean":"2024-09-19T08:44:19.302058+0000","last_became_active":"2024-09-19T08:43:11.461820+0000","last_became_peered":"2024-09-19T08:43:11.461820+0000","last_unstale":"2024-09-19T08:44:19.302058+0000","last_undegraded":"2024-09-19T08:44:19.302058+0000","last_fullsized":"2024-09-19T08:44:19.302058+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.910058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.311045+0000","last_change":"2024-09-19T08:44:19.311045+0000","last_active":"2024-09-19T08:44:19.311045+0000","last_peered":"2024-09-19T08:44:19.311045+0000","last_clean":"2024-09-19T08:44:19.311045+0000","last_became_active":"2024-09-19T08:44:19.310556+0000","last_became_peered":"2024-09-19T08:44:19.310556+0000","last_unstale":"2024-09-19T08:44:19.311045+0000","last_undegraded":"2024-09-19T08:44:19.311045+0000","last_fullsized":"2024-09-19T08:44:19.311045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.457039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306586+0000","last_change":"2024-09-19T08:43:20.550696+0000","last_active":"2024-09-19T08:44:19.306586+0000","last_peered":"2024-09-19T08:44:19.306586+0000","last_clean":"2024-09-19T08:44:19.306586+0000","last_became_active":"2024-09-19T08:43:20.550289+0000","last_became_peered":"2024-09-19T08:43:20.550289+0000","last_unstale":"2024-09-19T08:44:19.306586+0000","last_undegraded":"2024-09-19T08:44:19.306586+0000","last_fullsized":"2024-09-19T08:44:19.306586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:57.549540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306718+0000","last_change":"2024-09-19T08:43:11.460452+0000","last_active":"2024-09-19T08:44:19.306718+0000","last_peered":"2024-09-19T08:44:19.306718+0000","last_clean":"2024-09-19T08:44:19.306718+0000","last_became_active":"2024-09-19T08:43:11.460113+0000","last_became_peered":"2024-09-19T08:43:11.460113+0000","last_unstale":"2024-09-19T08:44:19.306718+0000","last_undegraded":"2024-09-19T08:44:19.306718+0000","last_fullsized":"2024-09-19T08:44:19.306718+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:10.440079+0000","last_clean_scrub_stamp":"2024-09-19T08:43:10.440079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:02.112243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303468+0000","last_change":"2024-09-19T08:43:13.506092+0000","last_active":"2024-09-19T08:44:19.303468+0000","last_peered":"2024-09-19T08:44:19.303468+0000","last_clean":"2024-09-19T08:44:19.303468+0000","last_became_active":"2024-09-19T08:43:13.505715+0000","last_became_peered":"2024-09-19T08:43:13.505715+0000","last_unstale":"2024-09-19T08:44:19.303468+0000","last_undegraded":"2024-09-19T08:44:19.303468+0000","last_fullsized":"2024-09-19T08:44:19.303468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:30.256482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306500+0000","last_change":"2024-09-19T08:43:20.540759+0000","last_active":"2024-09-19T08:44:19.306500+0000","last_peered":"2024-09-19T08:44:19.306500+0000","last_clean":"2024-09-19T08:44:19.306500+0000","last_became_active":"2024-09-19T08:43:20.540275+0000","last_became_peered":"2024-09-19T08:43:20.540275+0000","last_unstale":"2024-09-19T08:44:19.306500+0000","last_undegraded":"2024-09-19T08:44:19.306500+0000","last_fullsized":"2024-09-19T08:44:19.306500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:19.519730+0000","last_clean_scrub_stamp":"2024-09-19T08:43:19.519730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:20.032982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309950+0000","last_change":"2024-09-19T08:44:19.309950+0000","last_active":"2024-09-19T08:44:19.309950+0000","last_peered":"2024-09-19T08:44:19.309950+0000","last_clean":"2024-09-19T08:44:19.309950+0000","last_became_active":"2024-09-19T08:44:19.309553+0000","last_became_peered":"2024-09-19T08:44:19.309553+0000","last_unstale":"2024-09-19T08:44:19.309950+0000","last_undegraded":"2024-09-19T08:44:19.309950+0000","last_fullsized":"2024-09-19T08:44:19.309950+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:20.038745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306745+0000","last_change":"2024-09-19T08:43:13.507735+0000","last_active":"2024-09-19T08:44:19.306745+0000","last_peered":"2024-09-19T08:44:19.306745+0000","last_clean":"2024-09-19T08:44:19.306745+0000","last_became_active":"2024-09-19T08:43:13.507279+0000","last_became_peered":"2024-09-19T08:43:13.507279+0000","last_unstale":"2024-09-19T08:44:19.306745+0000","last_undegraded":"2024-09-19T08:44:19.306745+0000","last_fullsized":"2024-09-19T08:44:19.306745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:48.920412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306788+0000","last_change":"2024-09-19T08:43:13.504453+0000","last_active":"2024-09-19T08:44:19.306788+0000","last_peered":"2024-09-19T08:44:19.306788+0000","last_clean":"2024-09-19T08:44:19.306788+0000","last_became_active":"2024-09-19T08:43:13.503985+0000","last_became_peered":"2024-09-19T08:43:13.503985+0000","last_unstale":"2024-09-19T08:44:19.306788+0000","last_undegraded":"2024-09-19T08:44:19.306788+0000","last_fullsized":"2024-09-19T08:44:19.306788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:38.641817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303661+0000","last_change":"2024-09-19T08:43:13.509833+0000","last_active":"2024-09-19T08:44:19.303661+0000","last_peered":"2024-09-19T08:44:19.303661+0000","last_clean":"2024-09-19T08:44:19.303661+0000","last_became_active":"2024-09-19T08:43:13.509523+0000","last_became_peered":"2024-09-19T08:43:13.509523+0000","last_unstale":"2024-09-19T08:44:19.303661+0000","last_undegraded":"2024-09-19T08:44:19.303661+0000","last_fullsized":"2024-09-19T08:44:19.303661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:59.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303731+0000","last_change":"2024-09-19T08:43:13.502624+0000","last_active":"2024-09-19T08:44:19.303731+0000","last_peered":"2024-09-19T08:44:19.303731+0000","last_clean":"2024-09-19T08:44:19.303731+0000","last_became_active":"2024-09-19T08:43:13.502321+0000","last_became_peered":"2024-09-19T08:43:13.502321+0000","last_unstale":"2024-09-19T08:44:19.303731+0000","last_undegraded":"2024-09-19T08:44:19.303731+0000","last_fullsized":"2024-09-19T08:44:19.303731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:41.724026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301670+0000","last_change":"2024-09-19T08:43:13.515261+0000","last_active":"2024-09-19T08:44:19.301670+0000","last_peered":"2024-09-19T08:44:19.301670+0000","last_clean":"2024-09-19T08:44:19.301670+0000","last_became_active":"2024-09-19T08:43:13.514741+0000","last_became_peered":"2024-09-19T08:43:13.514741+0000","last_unstale":"2024-09-19T08:44:19.301670+0000","last_undegraded":"2024-09-19T08:44:19.301670+0000","last_fullsized":"2024-09-19T08:44:19.301670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:16.348859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307699+0000","last_change":"2024-09-19T08:43:13.512820+0000","last_active":"2024-09-19T08:44:19.307699+0000","last_peered":"2024-09-19T08:44:19.307699+0000","last_clean":"2024-09-19T08:44:19.307699+0000","last_became_active":"2024-09-19T08:43:13.512503+0000","last_became_peered":"2024-09-19T08:43:13.512503+0000","last_unstale":"2024-09-19T08:44:19.307699+0000","last_undegraded":"2024-09-19T08:44:19.307699+0000","last_fullsized":"2024-09-19T08:44:19.307699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:41.763855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306436+0000","last_change":"2024-09-19T08:43:13.501837+0000","last_active":"2024-09-19T08:44:19.306436+0000","last_peered":"2024-09-19T08:44:19.306436+0000","last_clean":"2024-09-19T08:44:19.306436+0000","last_became_active":"2024-09-19T08:43:13.501561+0000","last_became_peered":"2024-09-19T08:43:13.501561+0000","last_unstale":"2024-09-19T08:44:19.306436+0000","last_undegraded":"2024-09-19T08:44:19.306436+0000","last_fullsized":"2024-09-19T08:44:19.306436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:30.891617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306212+0000","last_change":"2024-09-19T08:43:13.506755+0000","last_active":"2024-09-19T08:44:19.306212+0000","last_peered":"2024-09-19T08:44:19.306212+0000","last_clean":"2024-09-19T08:44:19.306212+0000","last_became_active":"2024-09-19T08:43:13.506462+0000","last_became_peered":"2024-09-19T08:43:13.506462+0000","last_unstale":"2024-09-19T08:44:19.306212+0000","last_undegraded":"2024-09-19T08:44:19.306212+0000","last_fullsized":"2024-09-19T08:44:19.306212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:37.686741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306338+0000","last_change":"2024-09-19T08:43:13.506407+0000","last_active":"2024-09-19T08:44:19.306338+0000","last_peered":"2024-09-19T08:44:19.306338+0000","last_clean":"2024-09-19T08:44:19.306338+0000","last_became_active":"2024-09-19T08:43:13.506094+0000","last_became_peered":"2024-09-19T08:43:13.506094+0000","last_unstale":"2024-09-19T08:44:19.306338+0000","last_undegraded":"2024-09-19T08:44:19.306338+0000","last_fullsized":"2024-09-19T08:44:19.306338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:40.654865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626138+0000","last_change":"2024-09-19T08:43:13.502542+0000","last_active":"2024-09-19T08:44:19.626138+0000","last_peered":"2024-09-19T08:44:19.626138+0000","last_clean":"2024-09-19T08:44:19.626138+0000","last_became_active":"2024-09-19T08:43:13.502186+0000","last_became_peered":"2024-09-19T08:43:13.502186+0000","last_unstale":"2024-09-19T08:44:19.626138+0000","last_undegraded":"2024-09-19T08:44:19.626138+0000","last_fullsized":"2024-09-19T08:44:19.626138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:18.022089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303602+0000","last_change":"2024-09-19T08:43:13.500097+0000","last_active":"2024-09-19T08:44:19.303602+0000","last_peered":"2024-09-19T08:44:19.303602+0000","last_clean":"2024-09-19T08:44:19.303602+0000","last_became_active":"2024-09-19T08:43:13.499403+0000","last_became_peered":"2024-09-19T08:43:13.499403+0000","last_unstale":"2024-09-19T08:44:19.303602+0000","last_undegraded":"2024-09-19T08:44:19.303602+0000","last_fullsized":"2024-09-19T08:44:19.303602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:29.772783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301286+0000","last_change":"2024-09-19T08:43:13.509855+0000","last_active":"2024-09-19T08:44:19.301286+0000","last_peered":"2024-09-19T08:44:19.301286+0000","last_clean":"2024-09-19T08:44:19.301286+0000","last_became_active":"2024-09-19T08:43:13.509531+0000","last_became_peered":"2024-09-19T08:43:13.509531+0000","last_unstale":"2024-09-19T08:44:19.301286+0000","last_undegraded":"2024-09-19T08:44:19.301286+0000","last_fullsized":"2024-09-19T08:44:19.301286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:47.722940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.307332+0000","last_change":"2024-09-19T08:43:13.507443+0000","last_active":"2024-09-19T08:44:19.307332+0000","last_peered":"2024-09-19T08:44:19.307332+0000","last_clean":"2024-09-19T08:44:19.307332+0000","last_became_active":"2024-09-19T08:43:13.505626+0000","last_became_peered":"2024-09-19T08:43:13.505626+0000","last_unstale":"2024-09-19T08:44:19.307332+0000","last_undegraded":"2024-09-19T08:44:19.307332+0000","last_fullsized":"2024-09-19T08:44:19.307332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:27.130768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.300788+0000","last_change":"2024-09-19T08:43:13.513796+0000","last_active":"2024-09-19T08:44:19.300788+0000","last_peered":"2024-09-19T08:44:19.300788+0000","last_clean":"2024-09-19T08:44:19.300788+0000","last_became_active":"2024-09-19T08:43:13.513519+0000","last_became_peered":"2024-09-19T08:43:13.513519+0000","last_unstale":"2024-09-19T08:44:19.300788+0000","last_undegraded":"2024-09-19T08:44:19.300788+0000","last_fullsized":"2024-09-19T08:44:19.300788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:32.118184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302434+0000","last_change":"2024-09-19T08:43:13.515267+0000","last_active":"2024-09-19T08:44:19.302434+0000","last_peered":"2024-09-19T08:44:19.302434+0000","last_clean":"2024-09-19T08:44:19.302434+0000","last_became_active":"2024-09-19T08:43:13.514806+0000","last_became_peered":"2024-09-19T08:43:13.514806+0000","last_unstale":"2024-09-19T08:44:19.302434+0000","last_undegraded":"2024-09-19T08:44:19.302434+0000","last_fullsized":"2024-09-19T08:44:19.302434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:10.977591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.625741+0000","last_change":"2024-09-19T08:43:13.508047+0000","last_active":"2024-09-19T08:44:19.625741+0000","last_peered":"2024-09-19T08:44:19.625741+0000","last_clean":"2024-09-19T08:44:19.625741+0000","last_became_active":"2024-09-19T08:43:13.505069+0000","last_became_peered":"2024-09-19T08:43:13.505069+0000","last_unstale":"2024-09-19T08:44:19.625741+0000","last_undegraded":"2024-09-19T08:44:19.625741+0000","last_fullsized":"2024-09-19T08:44:19.625741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.321943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304194+0000","last_change":"2024-09-19T08:43:13.510178+0000","last_active":"2024-09-19T08:44:19.304194+0000","last_peered":"2024-09-19T08:44:19.304194+0000","last_clean":"2024-09-19T08:44:19.304194+0000","last_became_active":"2024-09-19T08:43:13.509620+0000","last_became_peered":"2024-09-19T08:43:13.509620+0000","last_unstale":"2024-09-19T08:44:19.304194+0000","last_undegraded":"2024-09-19T08:44:19.304194+0000","last_fullsized":"2024-09-19T08:44:19.304194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:01.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303442+0000","last_change":"2024-09-19T08:43:13.505288+0000","last_active":"2024-09-19T08:44:19.303442+0000","last_peered":"2024-09-19T08:44:19.303442+0000","last_clean":"2024-09-19T08:44:19.303442+0000","last_became_active":"2024-09-19T08:43:13.504813+0000","last_became_peered":"2024-09-19T08:43:13.504813+0000","last_unstale":"2024-09-19T08:44:19.303442+0000","last_undegraded":"2024-09-19T08:44:19.303442+0000","last_fullsized":"2024-09-19T08:44:19.303442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:17.612355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303574+0000","last_change":"2024-09-19T08:43:13.508392+0000","last_active":"2024-09-19T08:44:19.303574+0000","last_peered":"2024-09-19T08:44:19.303574+0000","last_clean":"2024-09-19T08:44:19.303574+0000","last_became_active":"2024-09-19T08:43:13.507924+0000","last_became_peered":"2024-09-19T08:43:13.507924+0000","last_unstale":"2024-09-19T08:44:19.303574+0000","last_undegraded":"2024-09-19T08:44:19.303574+0000","last_fullsized":"2024-09-19T08:44:19.303574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:41.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.443149+0000","last_change":"2024-09-19T08:43:13.513906+0000","last_active":"2024-09-19T08:44:19.443149+0000","last_peered":"2024-09-19T08:44:19.443149+0000","last_clean":"2024-09-19T08:44:19.443149+0000","last_became_active":"2024-09-19T08:43:13.513570+0000","last_became_peered":"2024-09-19T08:43:13.513570+0000","last_unstale":"2024-09-19T08:44:19.443149+0000","last_undegraded":"2024-09-19T08:44:19.443149+0000","last_fullsized":"2024-09-19T08:44:19.443149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:13.516639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303877+0000","last_change":"2024-09-19T08:43:13.513776+0000","last_active":"2024-09-19T08:44:19.303877+0000","last_peered":"2024-09-19T08:44:19.303877+0000","last_clean":"2024-09-19T08:44:19.303877+0000","last_became_active":"2024-09-19T08:43:13.513087+0000","last_became_peered":"2024-09-19T08:43:13.513087+0000","last_unstale":"2024-09-19T08:44:19.303877+0000","last_undegraded":"2024-09-19T08:44:19.303877+0000","last_fullsized":"2024-09-19T08:44:19.303877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:09.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.309988+0000","last_change":"2024-09-19T08:44:19.309988+0000","last_active":"2024-09-19T08:44:19.309988+0000","last_peered":"2024-09-19T08:44:19.309988+0000","last_clean":"2024-09-19T08:44:19.309988+0000","last_became_active":"2024-09-19T08:44:19.309639+0000","last_became_peered":"2024-09-19T08:44:19.309639+0000","last_unstale":"2024-09-19T08:44:19.309988+0000","last_undegraded":"2024-09-19T08:44:19.309988+0000","last_fullsized":"2024-09-19T08:44:19.309988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:04.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.626625+0000","last_change":"2024-09-19T08:43:13.513825+0000","last_active":"2024-09-19T08:44:19.626625+0000","last_peered":"2024-09-19T08:44:19.626625+0000","last_clean":"2024-09-19T08:44:19.626625+0000","last_became_active":"2024-09-19T08:43:13.513458+0000","last_became_peered":"2024-09-19T08:43:13.513458+0000","last_unstale":"2024-09-19T08:44:19.626625+0000","last_undegraded":"2024-09-19T08:44:19.626625+0000","last_fullsized":"2024-09-19T08:44:19.626625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:22.141180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.306378+0000","last_change":"2024-09-19T08:43:13.512512+0000","last_active":"2024-09-19T08:44:19.306378+0000","last_peered":"2024-09-19T08:44:19.306378+0000","last_clean":"2024-09-19T08:44:19.306378+0000","last_became_active":"2024-09-19T08:43:13.512117+0000","last_became_peered":"2024-09-19T08:43:13.512117+0000","last_unstale":"2024-09-19T08:44:19.306378+0000","last_undegraded":"2024-09-19T08:44:19.306378+0000","last_fullsized":"2024-09-19T08:44:19.306378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:05.381485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303897+0000","last_change":"2024-09-19T08:43:13.510732+0000","last_active":"2024-09-19T08:44:19.303897+0000","last_peered":"2024-09-19T08:44:19.303897+0000","last_clean":"2024-09-19T08:44:19.303897+0000","last_became_active":"2024-09-19T08:43:13.510412+0000","last_became_peered":"2024-09-19T08:43:13.510412+0000","last_unstale":"2024-09-19T08:44:19.303897+0000","last_undegraded":"2024-09-19T08:44:19.303897+0000","last_fullsized":"2024-09-19T08:44:19.303897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:32.057417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.301988+0000","last_change":"2024-09-19T08:43:13.509665+0000","last_active":"2024-09-19T08:44:19.301988+0000","last_peered":"2024-09-19T08:44:19.301988+0000","last_clean":"2024-09-19T08:44:19.301988+0000","last_became_active":"2024-09-19T08:43:13.509331+0000","last_became_peered":"2024-09-19T08:43:13.509331+0000","last_unstale":"2024-09-19T08:44:19.301988+0000","last_undegraded":"2024-09-19T08:44:19.301988+0000","last_fullsized":"2024-09-19T08:44:19.301988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:18.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303042+0000","last_change":"2024-09-19T08:43:13.498969+0000","last_active":"2024-09-19T08:44:19.303042+0000","last_peered":"2024-09-19T08:44:19.303042+0000","last_clean":"2024-09-19T08:44:19.303042+0000","last_became_active":"2024-09-19T08:43:13.498274+0000","last_became_peered":"2024-09-19T08:43:13.498274+0000","last_unstale":"2024-09-19T08:44:19.303042+0000","last_undegraded":"2024-09-19T08:44:19.303042+0000","last_fullsized":"2024-09-19T08:44:19.303042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:53.220934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.442931+0000","last_change":"2024-09-19T08:43:13.515101+0000","last_active":"2024-09-19T08:44:19.442931+0000","last_peered":"2024-09-19T08:44:19.442931+0000","last_clean":"2024-09-19T08:44:19.442931+0000","last_became_active":"2024-09-19T08:43:13.514476+0000","last_became_peered":"2024-09-19T08:43:13.514476+0000","last_unstale":"2024-09-19T08:44:19.442931+0000","last_undegraded":"2024-09-19T08:44:19.442931+0000","last_fullsized":"2024-09-19T08:44:19.442931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:34.864832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.303939+0000","last_change":"2024-09-19T08:43:13.513978+0000","last_active":"2024-09-19T08:44:19.303939+0000","last_peered":"2024-09-19T08:44:19.303939+0000","last_clean":"2024-09-19T08:44:19.303939+0000","last_became_active":"2024-09-19T08:43:13.513644+0000","last_became_peered":"2024-09-19T08:43:13.513644+0000","last_unstale":"2024-09-19T08:44:19.303939+0000","last_undegraded":"2024-09-19T08:44:19.303939+0000","last_fullsized":"2024-09-19T08:44:19.303939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.496383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.304208+0000","last_change":"2024-09-19T08:43:13.504697+0000","last_active":"2024-09-19T08:44:19.304208+0000","last_peered":"2024-09-19T08:44:19.304208+0000","last_clean":"2024-09-19T08:44:19.304208+0000","last_became_active":"2024-09-19T08:43:13.504329+0000","last_became_peered":"2024-09-19T08:43:13.504329+0000","last_unstale":"2024-09-19T08:44:19.304208+0000","last_undegraded":"2024-09-19T08:44:19.304208+0000","last_fullsized":"2024-09-19T08:44:19.304208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:54.393292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T08:44:19.302295+0000","last_change":"2024-09-19T08:43:13.514793+0000","last_active":"2024-09-19T08:44:19.302295+0000","last_peered":"2024-09-19T08:44:19.302295+0000","last_clean":"2024-09-19T08:44:19.302295+0000","last_became_active":"2024-09-19T08:43:13.514146+0000","last_became_peered":"2024-09-19T08:43:13.514146+0000","last_unstale":"2024-09-19T08:44:19.302295+0000","last_undegraded":"2024-09-19T08:44:19.302295+0000","last_fullsized":"2024-09-19T08:44:19.302295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:43:12.483834+0000","last_clean_scrub_stamp":"2024-09-19T08:43:12.483834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.616341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":118,"num_read_kb":124,"num_write":85,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":495741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36984,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708168,"statfs":{"total":95995035648,"available":95957164032,"internally_reserved":0,"allocated":1671168,"data_stored":1145718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1003520,"data_stored":500419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234031,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":495763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1597440,"data_stored":1090787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":991232,"data_stored":491645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1601536,"data_stored":1086291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":495763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":491749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":555190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":555738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":491735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:52.018 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:44:52.018 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:44:52.018 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:44:52.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T08:44:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:52.645 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:52 smithi018 ceph-mon[30956]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:52.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:52 smithi162 ceph-mon[34870]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 -- 172.21.15.18:0/2616338651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 msgr2=0x7fc9001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 --2- 172.21.15.18:0/2616338651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc9001067e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009900 tx=0x7fc8f402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 -- 172.21.15.18:0/2616338651 shutdown_connections 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 --2- 172.21.15.18:0/2616338651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc900106f10 0x7fc90010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 --2- 172.21.15.18:0/2616338651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc9001067e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 --2- 172.21.15.18:0/2616338651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc900101de0 0x7fc9001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 -- 172.21.15.18:0/2616338651 >> 172.21.15.18:0/2616338651 conn(0x7fc9000fd8c0 msgr2=0x7fc9000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 -- 172.21.15.18:0/2616338651 shutdown_connections 2024-09-19T08:44:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.725+0000 7fc906c92640 1 -- 172.21.15.18:0/2616338651 wait complete. 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 Processor -- start 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 -- start start 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc900101de0 0x7fc9000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc900074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc900106f10 0x7fc900074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc900111e20 con 0x7fc900102790 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc900111ca0 con 0x7fc900106f10 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc906c92640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc900111fa0 con 0x7fc900101de0 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc8fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc900074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc8fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc900074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51452/0 (socket says 172.21.15.18:51452) 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc8fffff640 1 -- 172.21.15.18:0/2655241112 learned_addr learned my addr 172.21.15.18:0/2655241112 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc904a2e640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc900101de0 0x7fc9000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.726+0000 7fc90522f640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc900106f10 0x7fc900074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fffff640 1 -- 172.21.15.18:0/2655241112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc900101de0 msgr2=0x7fc9000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fffff640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc900101de0 0x7fc9000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fffff640 1 -- 172.21.15.18:0/2655241112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc900106f10 msgr2=0x7fc900074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fffff640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc900106f10 0x7fc900074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fffff640 1 -- 172.21.15.18:0/2655241112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9001a6880 con 0x7fc900102790 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fffff640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc900074a30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4005940 tx=0x7fc8f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f403f030 con 0x7fc900102790 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8f4003aa0 con 0x7fc900102790 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9001a6b10 con 0x7fc900102790 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4035070 con 0x7fc900102790 2024-09-19T08:44:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.727+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9001a7040 con 0x7fc900102790 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.728+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9001021c0 con 0x7fc900102790 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.730+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc8f4042030 con 0x7fc900102790 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.730+0000 7fc8fdffb640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc8e80a3350 0x7fc8e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.730+0000 7fc904a2e640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc8e80a3350 0x7fc8e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.730+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fc8f40f0640 con 0x7fc900102790 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.731+0000 7fc904a2e640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc8e80a3350 0x7fc8e80a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0005fd0 tx=0x7fc8f000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.734+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8f40bc850 con 0x7fc900102790 2024-09-19T08:44:52.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:52 smithi150 ceph-mon[34610]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.949+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc90010a150 con 0x7fc900102790 2024-09-19T08:44:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.949+0000 7fc8fdffb640 1 -- 172.21.15.18:0/2655241112 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc8f40c0b50 con 0x7fc900102790 2024-09-19T08:44:52.950 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:52.950 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:44:52.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc8e80a3350 msgr2=0x7fc8e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc8e80a3350 0x7fc8e80a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0005fd0 tx=0x7fc8f000b390 comp rx=0 tx=0).stop 2024-09-19T08:44:52.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 msgr2=0x7fc900074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc900074a30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4005940 tx=0x7fc8f4004270 comp rx=0 tx=0).stop 2024-09-19T08:44:52.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 shutdown_connections 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc8e80a3350 0x7fc8e80a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc900106f10 0x7fc900074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc900102790 0x7fc900074a30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 --2- 172.21.15.18:0/2655241112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc900101de0 0x7fc9000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 >> 172.21.15.18:0/2655241112 conn(0x7fc9000fd8c0 msgr2=0x7fc9000fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 shutdown_connections 2024-09-19T08:44:52.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:52.951+0000 7fc906c92640 1 -- 172.21.15.18:0/2655241112 wait complete. 2024-09-19T08:44:53.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:53 smithi018 ceph-mon[30956]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:53.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:53 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2655241112' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:44:53.629 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:44:53.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:53.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:53 smithi162 ceph-mon[34870]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:53.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:53 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2655241112' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:44:53.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:53 smithi150 ceph-mon[34610]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:53.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:53 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2655241112' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:44:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1140914171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 msgr2=0x7f2b1810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1140914171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b1810bb50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009900 tx=0x7f2b0c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1140914171 shutdown_connections 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1140914171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1810c170 0x7f2b1810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1140914171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b1810bb50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1140914171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b18102d40 0x7f2b18103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.397+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1140914171 >> 172.21.15.18:0/1140914171 conn(0x7f2b180fc7a0 msgr2=0x7f2b180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.398+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1140914171 shutdown_connections 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.398+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1140914171 wait complete. 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.398+0000 7f2b1e77f640 1 Processor -- start 2024-09-19T08:44:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.398+0000 7f2b1e77f640 1 -- start start 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1e77f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b18102d40 0x7f2b181009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1e77f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b18100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1e77f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1810c170 0x7f2b18101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1e77f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18111e20 con 0x7f2b18103660 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1e77f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18111ca0 con 0x7f2b1810c170 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1e77f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18111fa0 con 0x7f2b18102d40 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b18100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b18100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51464/0 (socket says 172.21.15.18:51464) 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 -- 172.21.15.18:0/1092034667 learned_addr learned my addr 172.21.15.18:0/1092034667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b1cd1c640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1810c170 0x7f2b18101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b17fff640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b18102d40 0x7f2b181009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 -- 172.21.15.18:0/1092034667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b18102d40 msgr2=0x7f2b181009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b18102d40 0x7f2b181009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 -- 172.21.15.18:0/1092034667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1810c170 msgr2=0x7f2b18101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1810c170 0x7f2b18101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 -- 172.21.15.18:0/1092034667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b181a6810 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.399+0000 7f2b177fe640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b18100ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c005940 tx=0x7f2b0c031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.400+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c03f030 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.400+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b0c0043d0 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.400+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b181a6aa0 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.400+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c035070 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.400+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b181a6f80 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.401+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b18103120 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.402+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b0c042030 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.403+0000 7f2b157fa640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2b000a32d0 0x7f2b000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.403+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f2b0c0f0360 con 0x7f2b18103660 2024-09-19T08:44:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.403+0000 7f2b17fff640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2b000a32d0 0x7f2b000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.403+0000 7f2b17fff640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2b000a32d0 0x7f2b000a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009b60 tx=0x7f2b08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.406+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b0c0bcbc0 con 0x7f2b18103660 2024-09-19T08:44:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.619+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b181071e0 con 0x7f2b18103660 2024-09-19T08:44:54.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.620+0000 7f2b157fa640 1 -- 172.21.15.18:0/1092034667 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f2b0c0bc4c0 con 0x7f2b18103660 2024-09-19T08:44:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:54.621 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:44:54.621 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:44:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2b000a32d0 msgr2=0x7f2b000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2b000a32d0 0x7f2b000a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009b60 tx=0x7f2b08005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 msgr2=0x7f2b18100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b18100ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c005940 tx=0x7f2b0c031a10 comp rx=0 tx=0).stop 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 shutdown_connections 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2b000a32d0 0x7f2b000a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1810c170 0x7f2b18101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b18103660 0x7f2b18100ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 --2- 172.21.15.18:0/1092034667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b18102d40 0x7f2b181009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 >> 172.21.15.18:0/1092034667 conn(0x7f2b180fc7a0 msgr2=0x7f2b180fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 shutdown_connections 2024-09-19T08:44:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:54.622+0000 7f2b1e77f640 1 -- 172.21.15.18:0/1092034667 wait complete. 2024-09-19T08:44:55.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:55.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:55 smithi162 ceph-mon[34870]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:55.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:55 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1092034667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:55.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:55 smithi018 ceph-mon[30956]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:55.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:55 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1092034667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:55.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:55 smithi150 ceph-mon[34610]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:55.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:55 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1092034667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:56.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 -- 172.21.15.18:0/4258645753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1082a0 msgr2=0x7fb16c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 --2- 172.21.15.18:0/4258645753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1082a0 0x7fb16c10ec40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb164009cd0 tx=0x7fb16402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 -- 172.21.15.18:0/4258645753 shutdown_connections 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 --2- 172.21.15.18:0/4258645753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1082a0 0x7fb16c10ec40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 --2- 172.21.15.18:0/4258645753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1036e0 0x7fb16c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 --2- 172.21.15.18:0/4258645753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb16c102d30 0x7fb16c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 -- 172.21.15.18:0/4258645753 >> 172.21.15.18:0/4258645753 conn(0x7fb16c0fc7d0 msgr2=0x7fb16c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 -- 172.21.15.18:0/4258645753 shutdown_connections 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.122+0000 7fb172766640 1 -- 172.21.15.18:0/4258645753 wait complete. 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 Processor -- start 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 -- start start 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 0x7fb16c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:56.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb16c1082a0 0x7fb16c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c111f50 con 0x7fb16c102d30 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c111dd0 con 0x7fb16c1082a0 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb172766640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1120d0 con 0x7fb16c1036e0 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb16bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 0x7fb16c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb16bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 0x7fb16c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51476/0 (socket says 172.21.15.18:51476) 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.123+0000 7fb16bfff640 1 -- 172.21.15.18:0/44748491 learned_addr learned my addr 172.21.15.18:0/44748491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb170d03640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb16c1082a0 0x7fb16c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16b7fe640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16bfff640 1 -- 172.21.15.18:0/44748491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1036e0 msgr2=0x7fb16c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16bfff640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16bfff640 1 -- 172.21.15.18:0/44748491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb16c1082a0 msgr2=0x7fb16c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16bfff640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb16c1082a0 0x7fb16c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16bfff640 1 -- 172.21.15.18:0/44748491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c19d4a0 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb16bfff640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 0x7fb16c1984f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c890 tx=0x7fb15c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c004220 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c19d790 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb15c0043c0 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c004a00 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.124+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a5070 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.125+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c103110 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.127+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb15c004ba0 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.127+0000 7fb1697fa640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1540a32d0 0x7fb1540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.127+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb15c0cfea0 con 0x7fb16c102d30 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.127+0000 7fb16b7fe640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1540a32d0 0x7fb1540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.128+0000 7fb16b7fe640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1540a32d0 0x7fb1540a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb160005d90 tx=0x7fb160005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.131+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb15c014030 con 0x7fb16c102d30 2024-09-19T08:44:56.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.348+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb16c199850 con 0x7fb16c102d30 2024-09-19T08:44:56.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.348+0000 7fb1697fa640 1 -- 172.21.15.18:0/44748491 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fb15c09c700 con 0x7fb16c102d30 2024-09-19T08:44:56.349 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:56.349 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:44:56.350 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:44:56.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1540a32d0 msgr2=0x7fb1540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1540a32d0 0x7fb1540a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb160005d90 tx=0x7fb160005d20 comp rx=0 tx=0).stop 2024-09-19T08:44:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 msgr2=0x7fb16c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 0x7fb16c1984f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c890 tx=0x7fb15c00cd50 comp rx=0 tx=0).stop 2024-09-19T08:44:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 shutdown_connections 2024-09-19T08:44:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1540a32d0 0x7fb1540a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb16c1082a0 0x7fb16c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 --2- 172.21.15.18:0/44748491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102d30 0x7fb16c1984f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:56.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 >> 172.21.15.18:0/44748491 conn(0x7fb16c0fc7d0 msgr2=0x7fb16c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:56.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 shutdown_connections 2024-09-19T08:44:56.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:56.351+0000 7fb172766640 1 -- 172.21.15.18:0/44748491 wait complete. 2024-09-19T08:44:56.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:56 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/44748491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:56.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:56 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/44748491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:56.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:56 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/44748491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:57.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:57.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:57 smithi162 ceph-mon[34870]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:57.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:57 smithi018 ceph-mon[30956]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 -- 172.21.15.18:0/3528444649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0106f10 msgr2=0x7f55f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 --2- 172.21.15.18:0/3528444649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0106f10 0x7f55f010ea90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009ca0 tx=0x7f55e802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 -- 172.21.15.18:0/3528444649 shutdown_connections 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 --2- 172.21.15.18:0/3528444649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0106f10 0x7f55f010ea90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 --2- 172.21.15.18:0/3528444649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0102790 0x7f55f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 --2- 172.21.15.18:0/3528444649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 -- 172.21.15.18:0/3528444649 >> 172.21.15.18:0/3528444649 conn(0x7f55f00fd8c0 msgr2=0x7f55f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 -- 172.21.15.18:0/3528444649 shutdown_connections 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.796+0000 7f55f5145640 1 -- 172.21.15.18:0/3528444649 wait complete. 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.797+0000 7f55f5145640 1 Processor -- start 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.797+0000 7f55f5145640 1 -- start start 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.797+0000 7f55f5145640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.797+0000 7f55f5145640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0102790 0x7f55f0198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.797+0000 7f55f5145640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0106f10 0x7f55f019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55eed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55eed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f0198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:55148/0 (socket says 172.21.15.18:55148) 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55eed9d640 1 -- 172.21.15.18:0/3266120965 learned_addr learned my addr 172.21.15.18:0/3266120965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0102790 0x7f55f0198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0111f10 con 0x7f55f0102790 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0111d90 con 0x7f55f0106f10 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0112090 con 0x7f55f0101de0 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ef59e640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0106f10 0x7f55f019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 -- 172.21.15.18:0/3266120965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 msgr2=0x7f55f0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 -- 172.21.15.18:0/3266120965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0106f10 msgr2=0x7f55f019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0106f10 0x7f55f019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f019d400 con 0x7f55f0102790 2024-09-19T08:44:57.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55eed9d640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ef59e640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0106f10 0x7f55f019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.798+0000 7f55ee59c640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0102790 0x7f55f0198990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55e400b3f0 tx=0x7f55e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.799+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4015020 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.799+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55e4011ce0 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.799+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f019d6f0 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.799+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4010d80 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.799+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f01a4fd0 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.800+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f01021c0 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.801+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f55e4018020 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.801+0000 7f55d7fff640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55d80a3350 0x7f55d80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.802+0000 7f55eed9d640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55d80a3350 0x7f55d80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.802+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f55e40cf470 con 0x7f55f0102790 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.802+0000 7f55eed9d640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55d80a3350 0x7f55d80a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009e10 tx=0x7f55e00091c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.806+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55e401f020 con 0x7f55f0102790 2024-09-19T08:44:57.819 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:57 smithi150 ceph-mon[34610]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:44:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.983+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55f002d7c0 con 0x7f55f0102790 2024-09-19T08:44:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.985+0000 7f55d7fff640 1 -- 172.21.15.18:0/3266120965 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24718 (secure 0 0 0) 0x7f55e409bd80 con 0x7f55f0102790 2024-09-19T08:44:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":88,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:44:19.297394+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55d80a3350 msgr2=0x7f55d80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55d80a3350 0x7f55d80a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009e10 tx=0x7f55e00091c0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0102790 msgr2=0x7f55f0198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0102790 0x7f55f0198990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55e400b3f0 tx=0x7f55e400b8b0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 shutdown_connections 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55d80a3350 0x7f55d80a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55f0106f10 0x7f55f019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55f0102790 0x7f55f0198990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 --2- 172.21.15.18:0/3266120965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55f0101de0 0x7f55f0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.987+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 >> 172.21.15.18:0/3266120965 conn(0x7f55f00fd8c0 msgr2=0x7f55f00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.988+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 shutdown_connections 2024-09-19T08:44:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:57.988+0000 7f55f5145640 1 -- 172.21.15.18:0/3266120965 wait complete. 2024-09-19T08:44:58.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:58 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3266120965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:58.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3266120965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:58.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:58 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3266120965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:58.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:59.542 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:44:59 smithi018 ceph-mon[30956]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 -- 172.21.15.18:0/2407383323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160106f10 msgr2=0x7f516010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 --2- 172.21.15.18:0/2407383323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160106f10 0x7f516010ea90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5158009ca0 tx=0x7f515802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 -- 172.21.15.18:0/2407383323 shutdown_connections 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 --2- 172.21.15.18:0/2407383323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160106f10 0x7f516010ea90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 --2- 172.21.15.18:0/2407383323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5160102790 0x7f51601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 --2- 172.21.15.18:0/2407383323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160101de0 0x7f51601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 -- 172.21.15.18:0/2407383323 >> 172.21.15.18:0/2407383323 conn(0x7f51600fd8c0 msgr2=0x7f51600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 -- 172.21.15.18:0/2407383323 shutdown_connections 2024-09-19T08:44:59.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.622+0000 7f51686e3640 1 -- 172.21.15.18:0/2407383323 wait complete. 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 Processor -- start 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 -- start start 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5160101de0 0x7f51600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 0x7f5160074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160106f10 0x7f5160074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5160111e20 con 0x7f5160102790 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5160111ca0 con 0x7f5160106f10 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f51686e3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5160111fa0 con 0x7f5160101de0 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f5165c7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 0x7f5160074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:59.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f5165c7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 0x7f5160074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45200/0 (socket says 172.21.15.18:45200) 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.623+0000 7f5165c7e640 1 -- 172.21.15.18:0/334038471 learned_addr learned my addr 172.21.15.18:0/334038471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f516647f640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5160101de0 0x7f51600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5166c80640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160106f10 0x7f5160074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5165c7e640 1 -- 172.21.15.18:0/334038471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5160101de0 msgr2=0x7f51600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5165c7e640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5160101de0 0x7f51600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5165c7e640 1 -- 172.21.15.18:0/334038471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160106f10 msgr2=0x7f5160074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5165c7e640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160106f10 0x7f5160074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5165c7e640 1 -- 172.21.15.18:0/334038471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51601a67b0 con 0x7f5160102790 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5166c80640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160106f10 0x7f5160074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f5165c7e640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 0x7f5160074a30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f515000d950 tx=0x7f515000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150017070 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5150009c30 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51601a6aa0 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515000f620 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.624+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51601a7030 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.625+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51601021c0 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.626+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f51500109a0 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.627+0000 7f51577fe640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f514c0a3350 0x7f514c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.627+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f51500cf930 con 0x7f5160102790 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.627+0000 7f516647f640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f514c0a3350 0x7f514c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.628+0000 7f516647f640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f514c0a3350 0x7f514c0a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f515c0058c0 tx=0x7f515c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.631+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5150009de0 con 0x7f5160102790 2024-09-19T08:44:59.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:44:59 smithi162 ceph-mon[34870]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:59.716 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:44:59 smithi150 ceph-mon[34610]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:44:59.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.844+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5160109bc0 con 0x7f5160102790 2024-09-19T08:44:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.844+0000 7f51577fe640 1 -- 172.21.15.18:0/334038471 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f515009c190 con 0x7f5160102790 2024-09-19T08:44:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:44:59.845 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:44:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.847+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f514c0a3350 msgr2=0x7f514c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.847+0000 7f51686e3640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f514c0a3350 0x7f514c0a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f515c0058c0 tx=0x7f515c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.847+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 msgr2=0x7f5160074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.847+0000 7f51686e3640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 0x7f5160074a30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f515000d950 tx=0x7f515000de10 comp rx=0 tx=0).stop 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 shutdown_connections 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f514c0a3350 0x7f514c0a5810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5160106f10 0x7f5160074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160102790 0x7f5160074a30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 --2- 172.21.15.18:0/334038471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5160101de0 0x7f51600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:59.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 >> 172.21.15.18:0/334038471 conn(0x7f51600fd8c0 msgr2=0x7f51600fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:59.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 shutdown_connections 2024-09-19T08:44:59.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:44:59.848+0000 7f51686e3640 1 -- 172.21.15.18:0/334038471 wait complete. 2024-09-19T08:45:00.606 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:00 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/334038471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:00.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:43:14.179526+0000', 'modified': '2024-09-19T08:43:56.358444+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6839/1612914765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 1612914765}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 1612914765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.150:6839/3054116303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6838', 'nonce': 3054116303}, {'type': 'v1', 'addr': '172.21.15.150:6839', 'nonce': 3054116303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-19T08:45:00.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:45:00.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:45:00.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:00 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/334038471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:00.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:00 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/334038471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:00.901 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 -- 172.21.15.18:0/591035844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4102d40 msgr2=0x7f21c4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 --2- 172.21.15.18:0/591035844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4102d40 0x7f21c4103120 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009900 tx=0x7f21b802a480 comp rx=0 tx=0).stop 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 -- 172.21.15.18:0/591035844 shutdown_connections 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 --2- 172.21.15.18:0/591035844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c410c170 0x7f21c410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 --2- 172.21.15.18:0/591035844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c4103660 0x7f21c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 --2- 172.21.15.18:0/591035844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4102d40 0x7f21c4103120 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 -- 172.21.15.18:0/591035844 >> 172.21.15.18:0/591035844 conn(0x7f21c40fc7a0 msgr2=0x7f21c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 -- 172.21.15.18:0/591035844 shutdown_connections 2024-09-19T08:45:01.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.410+0000 7f21cac2a640 1 -- 172.21.15.18:0/591035844 wait complete. 2024-09-19T08:45:01.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 Processor -- start 2024-09-19T08:45:01.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 -- start start 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c4102d40 0x7f21c41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c4103660 0x7f21c4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 0x7f21c4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4111e60 con 0x7f21c410c170 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4111ce0 con 0x7f21c4103660 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21cac2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4111fe0 con 0x7f21c4102d40 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.411+0000 7f21c91c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 0x7f21c4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 0x7f21c4101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45214/0 (socket says 172.21.15.18:45214) 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 -- 172.21.15.18:0/3246059421 learned_addr learned my addr 172.21.15.18:0/3246059421 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c89c6640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c4102d40 0x7f21c41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c3fff640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c4103660 0x7f21c4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 -- 172.21.15.18:0/3246059421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c4102d40 msgr2=0x7f21c41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c4102d40 0x7f21c41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 -- 172.21.15.18:0/3246059421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c4103660 msgr2=0x7f21c4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c4103660 0x7f21c4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 -- 172.21.15.18:0/3246059421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c41a68a0 con 0x7f21c410c170 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c89c6640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c4102d40 0x7f21c41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c91c7640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 0x7f21c4101420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00eaa0 tx=0x7f21bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c1ffb640 1 -- 172.21.15.18:0/3246059421 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00cdb0 con 0x7f21c410c170 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c1ffb640 1 -- 172.21.15.18:0/3246059421 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21bc005020 con 0x7f21c410c170 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41a6b90 con 0x7f21c410c170 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.412+0000 7f21c1ffb640 1 -- 172.21.15.18:0/3246059421 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0116d0 con 0x7f21c410c170 2024-09-19T08:45:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.413+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c41a70d0 con 0x7f21c410c170 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.415+0000 7f21c1ffb640 1 -- 172.21.15.18:0/3246059421 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f21bc0051d0 con 0x7f21c410c170 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.415+0000 7f21cd003740 1 Processor -- start 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.415+0000 7f21cd003740 1 -- start start 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.415+0000 7f21cd003740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a722272db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.415+0000 7f21cd003740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21cd003740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21cd003740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a7221d9090 con 0x55a72227dbb0 2024-09-19T08:45:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21cd003740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a722180a70 con 0x55a7222732f0 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21cd003740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a7221d5050 con 0x55a7222729d0 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c1ffb640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f21b40a3350 0x7f21b40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45220/0 (socket says 172.21.15.18:45220) 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 -- 172.21.15.18:0/2415153366 learned_addr learned my addr 172.21.15.18:0/2415153366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c89c6640 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a722272db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c1ffb640 1 -- 172.21.15.18:0/3246059421 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f21bc0d0060 con 0x7f21c410c170 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c91c7640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f21b40a3350 0x7f21b40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 -- 172.21.15.18:0/2415153366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 msgr2=0x55a722272db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a722272db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 -- 172.21.15.18:0/2415153366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 msgr2=0x55a72227d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 -- 172.21.15.18:0/2415153366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a72218d130 con 0x55a72227dbb0 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ffa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f21b0016530 tx=0x7f21b000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf862aa9a4a7636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.416+0000 7f21c91c7640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f21b40a3350 0x7f21b40a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00cfd0 tx=0x7f21bc005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21aeffd640 1 -- 172.21.15.18:0/2415153366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0018430 con 0x55a72227dbb0 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21aeffd640 1 -- 172.21.15.18:0/2415153366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21b0018a80 con 0x55a72227dbb0 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21aeffd640 1 -- 172.21.15.18:0/2415153366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0017870 con 0x55a72227dbb0 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 -- 172.21.15.18:0/2415153366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 msgr2=0x55a72227ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ffa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f21b0016530 tx=0x7f21b000a360 comp rx=0 tx=0).stop 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 -- 172.21.15.18:0/2415153366 shutdown_connections 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ffa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 --2- 172.21.15.18:0/2415153366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a722272db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 -- 172.21.15.18:0/2415153366 >> 172.21.15.18:0/2415153366 conn(0x55a72226ef60 msgr2=0x55a72226f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 -- 172.21.15.18:0/2415153366 shutdown_connections 2024-09-19T08:45:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.417+0000 7f21cd003740 1 -- 172.21.15.18:0/2415153366 wait complete. 2024-09-19T08:45:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 -- start start 2024-09-19T08:45:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 Processor -- start 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a72227d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222732f0 0x55a72227a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a72227dbb0 0x55a72227ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a722280780 con 0x55a7222729d0 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a722193f20 con 0x55a72227dbb0 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a722280900 con 0x55a7222732f0 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21cd003740 10 client.0 _ll_register_callbacks cb 0x55a72215d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.418+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a72227d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a72227d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45224/0 (socket says 172.21.15.18:45224) 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 -- 172.21.15.18:0/3673905983 learned_addr learned my addr 172.21.15.18:0/3673905983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c89c6640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222732f0 0x55a72227a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a72227dbb0 0x55a72227ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 -- 172.21.15.18:0/3673905983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222732f0 msgr2=0x55a72227a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222732f0 0x55a72227a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 -- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a72227dbb0 msgr2=0x55a72227ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a72227dbb0 0x55a72227ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 -- 172.21.15.18:0/3673905983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a721f4a2b0 con 0x55a7222729d0 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c89c6640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222732f0 0x55a72227a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21c3fff640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a72227d400 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f21b000ad80 tx=0x7f21b000ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f0df0d51c7782e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21a3fff640 1 -- 172.21.15.18:0/3673905983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0018700 con 0x55a7222729d0 2024-09-19T08:45:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21a3fff640 1 -- 172.21.15.18:0/3673905983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f21b00059c0 con 0x55a7222729d0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21b0018a80 con 0x55a7222729d0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21a3fff640 1 -- 172.21.15.18:0/3673905983 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f21b0031050 con 0x55a7222729d0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21cd003740 10 client.15072 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.419+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a72228c050 con 0x55a7222729d0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21a3fff640 1 -- 172.21.15.18:0/3673905983 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21b0018a80 con 0x55a7222729d0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21a3fff640 1 -- 172.21.15.18:0/3673905983 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f21b0012050 con 0x55a7222729d0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21cd003740 10 client.15072 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21cd003740 10 client.15072 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21cd003740 20 client.15072 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21cd003740 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a72228f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21cd003740 4 client.15072 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7221e6600 con 0x55a72228d3f0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.420+0000 7f21c89c6640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a72228f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.421+0000 7f21a3fff640 10 client.15072 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.421+0000 7f21c89c6640 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a72228f5f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5609357d9546d45 server_cookie=55d44fdf743fd3be in_seq=0 out_seq=0 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.421+0000 7f21a3fff640 1 -- 172.21.15.18:0/3673905983 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7221e6600 con 0x55a72228d3f0 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.421+0000 7f21a3fff640 10 client.15072 handle_command_reply: tid=0 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.421+0000 7f21cd003740 1 client.15072 shutdown 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 msgr2=0x55a72227d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a72227d400 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f21b000ad80 tx=0x7f21b000ad10 comp rx=0 tx=0).stop 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 shutdown_connections 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a72228f5f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21a3fff640 0 client.15072 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a72227dbb0 0x55a72227ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222732f0 0x55a72227a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 --2- 172.21.15.18:0/3673905983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a72227d400 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 >> 172.21.15.18:0/3673905983 conn(0x55a72226ef60 msgr2=0x55a722274c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 shutdown_connections 2024-09-19T08:45:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 1 -- 172.21.15.18:0/3673905983 wait complete. 2024-09-19T08:45:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.422+0000 7f21cd003740 20 client.15072 trim_cache size 0 max 16384 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.439+0000 7f21cd003740 1 Processor -- start 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 -- start start 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a72228f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a72228d930 con 0x55a72227dbb0 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a72228e000 con 0x55a7222732f0 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21cd003740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a72228e6d0 con 0x55a7222729d0 2024-09-19T08:45:01.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45236/0 (socket says 172.21.15.18:45236) 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 -- 172.21.15.18:0/2608141073 learned_addr learned my addr 172.21.15.18:0/2608141073 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c89c6640 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 -- 172.21.15.18:0/2608141073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 msgr2=0x55a72228f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a72228f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 -- 172.21.15.18:0/2608141073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 msgr2=0x55a72227a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 -- 172.21.15.18:0/2608141073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a72227d770 con 0x55a72227dbb0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c89c6640 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21c3fff640 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ac50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f21b0004810 tx=0x7f21b00046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f06ada022c91c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.440+0000 7f21ae7fc640 1 -- 172.21.15.18:0/2608141073 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b000a220 con 0x55a72227dbb0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21ae7fc640 1 -- 172.21.15.18:0/2608141073 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21b0024480 con 0x55a72227dbb0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21ae7fc640 1 -- 172.21.15.18:0/2608141073 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0017220 con 0x55a72227dbb0 2024-09-19T08:45:01.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 -- 172.21.15.18:0/2608141073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 msgr2=0x55a72227ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ac50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f21b0004810 tx=0x7f21b00046a0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 -- 172.21.15.18:0/2608141073 shutdown_connections 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a72227dbb0 0x55a72227ac50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a72227a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 --2- 172.21.15.18:0/2608141073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a7222729d0 0x55a72228f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 -- 172.21.15.18:0/2608141073 >> 172.21.15.18:0/2608141073 conn(0x55a72226ef60 msgr2=0x55a72226f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 -- 172.21.15.18:0/2608141073 shutdown_connections 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 -- 172.21.15.18:0/2608141073 wait complete. 2024-09-19T08:45:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.441+0000 7f21cd003740 1 -- start start 2024-09-19T08:45:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 Processor -- start 2024-09-19T08:45:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a722297ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a722298020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a72227dbb0 0x55a722290e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a72228f470 con 0x55a7222729d0 2024-09-19T08:45:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a72228eda0 con 0x55a7222732f0 2024-09-19T08:45:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a72228fb40 con 0x55a72227dbb0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21cd003740 10 client.0 _ll_register_callbacks cb 0x7f21b8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a722297ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a722297ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45250/0 (socket says 172.21.15.18:45250) 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 -- 172.21.15.18:0/1036388779 learned_addr learned my addr 172.21.15.18:0/1036388779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a72227dbb0 0x55a722290e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c89c6640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a722298020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 -- 172.21.15.18:0/1036388779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a72227dbb0 msgr2=0x55a722290e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a72227dbb0 0x55a722290e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 -- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 msgr2=0x55a722298020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a722298020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.442+0000 7f21c3fff640 1 -- 172.21.15.18:0/1036388779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a722291690 con 0x55a7222729d0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21c3fff640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a722297ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f21b000aae0 tx=0x7f21b000a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc5cb3c062f34d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21a3fff640 1 -- 172.21.15.18:0/1036388779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0045020 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21a3fff640 1 -- 172.21.15.18:0/1036388779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f21b0017090 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21b0024480 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21a3fff640 1 -- 172.21.15.18:0/1036388779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f21b000a220 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21cd003740 10 client.15078 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a722296050 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21a3fff640 1 -- 172.21.15.18:0/1036388779 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21b0024480 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21a3fff640 1 -- 172.21.15.18:0/1036388779 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f21b0012040 con 0x55a7222729d0 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21cd003740 10 client.15078 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21cd003740 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.443+0000 7f21cd003740 20 client.15078 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21cd003740 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a7222fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21cd003740 4 client.15078 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:45:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "status"}) -- 0x55a7221e0b10 con 0x55a72228d3f0 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21c89c6640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a7222fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21c89c6640 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a7222fb5c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31ec6352652af2c server_cookie=51b01d7d3c01192b in_seq=0 out_seq=0 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21a3fff640 10 client.15078 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.444+0000 7f21a3fff640 1 -- 172.21.15.18:0/1036388779 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55a7221e0b10 con 0x55a72228d3f0 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21a3fff640 10 client.15078 handle_command_reply: tid=0 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 client.15078 shutdown 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 msgr2=0x55a722297ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a722297ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f21b000aae0 tx=0x7f21b000a770 comp rx=0 tx=0).stop 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 shutdown_connections 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a72228d3f0 0x55a7222fb5c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a72227dbb0 0x55a722290e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a7222732f0 0x55a722298020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 --2- 172.21.15.18:0/1036388779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7222729d0 0x55a722297ae0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 >> 172.21.15.18:0/1036388779 conn(0x55a72226ef60 msgr2=0x55a72227a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21a3fff640 0 client.15078 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 shutdown_connections 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 1 -- 172.21.15.18:0/1036388779 wait complete. 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.445+0000 7f21cd003740 20 client.15078 trim_cache size 0 max 16384 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "ed3de594-7661-11ef-bceb-c7b262605968", 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24497, 2024-09-19T08:45:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 106.933361457, 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 21, 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 88, 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 117.186009756 2024-09-19T08:45:01.453 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f21b40a3350 msgr2=0x7f21b40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f21b40a3350 0x7f21b40a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00cfd0 tx=0x7f21bc005830 comp rx=0 tx=0).stop 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 msgr2=0x7f21c4101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 0x7f21c4101420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00eaa0 tx=0x7f21bc00ef60 comp rx=0 tx=0).stop 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 shutdown_connections 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f21b40a3350 0x7f21b40a5810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c410c170 0x7f21c4101420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21c4103660 0x7f21c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 --2- 172.21.15.18:0/3246059421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21c4102d40 0x7f21c41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 >> 172.21.15.18:0/3246059421 conn(0x7f21c40fc7a0 msgr2=0x7f21c40fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 shutdown_connections 2024-09-19T08:45:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:01.446+0000 7f21cac2a640 1 -- 172.21.15.18:0/3246059421 wait complete. 2024-09-19T08:45:01.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:01 smithi162 ceph-mon[34870]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:01.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:01 smithi018 ceph-mon[30956]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:01.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:01 smithi150 ceph-mon[34610]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:02.259 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T08:45:02.259 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:45:02.269 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:45:02.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T08:45:02.531 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:03.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 -- 172.21.15.18:0/236803015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0107900 msgr2=0x7f7fb0109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:03.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/236803015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0107900 0x7f7fb0109d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009ca0 tx=0x7f7fa802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 -- 172.21.15.18:0/236803015 shutdown_connections 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/236803015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0107900 0x7f7fb0109d50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/236803015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/236803015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb01026a0 0x7f7fb0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.003+0000 7f7fb86f6640 1 -- 172.21.15.18:0/236803015 >> 172.21.15.18:0/236803015 conn(0x7f7fb00fc2a0 msgr2=0x7f7fb00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 -- 172.21.15.18:0/236803015 shutdown_connections 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 -- 172.21.15.18:0/236803015 wait complete. 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 Processor -- start 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 -- start start 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb01026a0 0x7f7fb0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb0107900 0x7f7fb019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb010d750 con 0x7f7fb0104fd0 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb010d5d0 con 0x7f7fb01026a0 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb86f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb010d8d0 con 0x7f7fb0107900 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb5c91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.004+0000 7f7fb5c91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45270/0 (socket says 172.21.15.18:45270) 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 -- 172.21.15.18:0/3196877388 learned_addr learned my addr 172.21.15.18:0/3196877388 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb6492640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb01026a0 0x7f7fb0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb6c93640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb0107900 0x7f7fb019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 -- 172.21.15.18:0/3196877388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb0107900 msgr2=0x7f7fb019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb0107900 0x7f7fb019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 -- 172.21.15.18:0/3196877388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb01026a0 msgr2=0x7f7fb0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb01026a0 0x7f7fb0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 -- 172.21.15.18:0/3196877388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb019fa90 con 0x7f7fb0104fd0 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb6c93640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb0107900 0x7f7fb019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb5c91640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01983a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000c970 tx=0x7f7fa000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0007bb0 con 0x7f7fb0104fd0 2024-09-19T08:45:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb019fd80 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fa0007d50 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000f450 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.005+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01a0240 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.006+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb00fdd90 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.008+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7fa0004e70 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.008+0000 7f7fa77fe640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7f9c0a3300 0x7f7f9c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.008+0000 7f7fb6492640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7f9c0a3300 0x7f7f9c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.008+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f7fa00cfe70 con 0x7f7fb0104fd0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.009+0000 7f7fb6492640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7f9c0a3300 0x7f7f9c0a57c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0058c0 tx=0x7f7fac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:03.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.011+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7fa0014030 con 0x7f7fb0104fd0 2024-09-19T08:45:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.201+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7fb0062630 con 0x7f7f9c0a3300 2024-09-19T08:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.203+0000 7f7fa77fe640 1 -- 172.21.15.18:0/3196877388 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7fb0062630 con 0x7f7f9c0a3300 2024-09-19T08:45:03.203 INFO:teuthology.orchestra.run.smithi018.stdout:Backend: cephadm 2024-09-19T08:45:03.203 INFO:teuthology.orchestra.run.smithi018.stdout:Available: Yes 2024-09-19T08:45:03.203 INFO:teuthology.orchestra.run.smithi018.stdout:Paused: No 2024-09-19T08:45:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7f9c0a3300 msgr2=0x7f7f9c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7f9c0a3300 0x7f7f9c0a57c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0058c0 tx=0x7f7fac00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 msgr2=0x7f7fb01983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01983a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000c970 tx=0x7f7fa000ce30 comp rx=0 tx=0).stop 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 shutdown_connections 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7f9c0a3300 0x7f7f9c0a57c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb0107900 0x7f7fb019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104fd0 0x7f7fb01983a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 --2- 172.21.15.18:0/3196877388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb01026a0 0x7f7fb0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 >> 172.21.15.18:0/3196877388 conn(0x7f7fb00fc2a0 msgr2=0x7f7fb0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 shutdown_connections 2024-09-19T08:45:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:03.205+0000 7f7fb86f6640 1 -- 172.21.15.18:0/3196877388 wait complete. 2024-09-19T08:45:03.525 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:03 smithi018 ceph-mon[30956]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:03.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:03 smithi162 ceph-mon[34870]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:03.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:03 smithi150 ceph-mon[34610]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:03.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T08:45:04.138 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:04.546 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:04 smithi018 ceph-mon[30956]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:04.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 -- 172.21.15.18:0/3496561283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 msgr2=0x7f5f2c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:04.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3496561283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c074680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009ca0 tx=0x7f5f1c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 -- 172.21.15.18:0/3496561283 shutdown_connections 2024-09-19T08:45:04.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3496561283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 0x7f5f2c1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3496561283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c074c50 0x7f5f2c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3496561283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c074680 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 -- 172.21.15.18:0/3496561283 >> 172.21.15.18:0/3496561283 conn(0x7f5f2c0fd390 msgr2=0x7f5f2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.629+0000 7f5f334ad640 1 -- 172.21.15.18:0/3496561283 shutdown_connections 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 -- 172.21.15.18:0/3496561283 wait complete. 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 Processor -- start 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 -- start start 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c074c50 0x7f5f2c19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 0x7f5f2c1a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c113d50 con 0x7f5f2c076220 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c113bd0 con 0x7f5f2c10e1e0 2024-09-19T08:45:04.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f334ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c113ed0 con 0x7f5f2c074c50 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f30a48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f30a48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c19e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45290/0 (socket says 172.21.15.18:45290) 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.630+0000 7f5f30a48640 1 -- 172.21.15.18:0/3278469883 learned_addr learned my addr 172.21.15.18:0/3278469883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f31249640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c074c50 0x7f5f2c19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f31a4a640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 0x7f5f2c1a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f30a48640 1 -- 172.21.15.18:0/3278469883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c074c50 msgr2=0x7f5f2c19e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f30a48640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c074c50 0x7f5f2c19e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f30a48640 1 -- 172.21.15.18:0/3278469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 msgr2=0x7f5f2c1a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f30a48640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 0x7f5f2c1a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f30a48640 1 -- 172.21.15.18:0/3278469883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c1a5ff0 con 0x7f5f2c076220 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f31a4a640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 0x7f5f2c1a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:04.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f30a48640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c19e900 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000d770 tx=0x7f5f2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20017070 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c1a62e0 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f200054d0 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20004cf0 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.631+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c1a6820 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.632+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2c103b80 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.633+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f20004e90 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.634+0000 7f5f2a7fc640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5f140a3300 0x7f5f140a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.634+0000 7f5f31249640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5f140a3300 0x7f5f140a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.634+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f5f200cfc80 con 0x7f5f2c076220 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.635+0000 7f5f31249640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5f140a3300 0x7f5f140a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c000f80 tx=0x7f5f1c031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:04.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.637+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f2009c4e0 con 0x7f5f2c076220 2024-09-19T08:45:04.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:04 smithi162 ceph-mon[34870]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:04.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:04 smithi150 ceph-mon[34610]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:04.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.823+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5f2c062630 con 0x7f5f140a3300 2024-09-19T08:45:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.835+0000 7f5f2a7fc640 1 -- 172.21.15.18:0/3278469883 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7f5f2c062630 con 0x7f5f140a3300 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.a smithi018 running (2m) 52s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 47a4a74282f7 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.b smithi150 running (2m) 53s ago 2m 26.3M - 19.1.1-361-g2f599a46 d2baa855c067 5ac16a95de5c 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.c smithi162 running (2m) 53s ago 2m 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 1235ebeb9742 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.d smithi018 running (2m) 52s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 7b98b55aeb0c 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.e smithi150 running (2m) 53s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 0deda23b21cc 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.f smithi162 running (2m) 53s ago 2m 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 68f85d3ded1a 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.g smithi018 running (2m) 52s ago 2m 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 4bb638834fd6 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.h smithi150 running (2m) 53s ago 2m 15.8M - 19.1.1-361-g2f599a46 d2baa855c067 74d2786b59f0 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.i smithi162 running (2m) 53s ago 2m 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 5e0a2bdcc2b4 2024-09-19T08:45:04.836 INFO:teuthology.orchestra.run.smithi018.stdout:mds.j smithi018 running (2m) 52s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 9078a9be863a 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mds.k smithi150 running (2m) 53s ago 2m 16.0M - 19.1.1-361-g2f599a46 d2baa855c067 24a880c561b4 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mds.l smithi162 running (2m) 53s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 19be58d02b92 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.x smithi018 *:9283,8765 running (9m) 52s ago 9m 505M - 19.1.1-361-g2f599a46 d2baa855c067 93393142f36a 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.y smithi150 *:8443,8765 running (7m) 53s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 8b6d7326af27 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.z smithi162 *:8443,8765 running (7m) 53s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 702bb604e12e 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a smithi018 running (9m) 52s ago 9m 50.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 d701052a226b 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b smithi150 running (8m) 53s ago 8m 38.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c40312751b19 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c smithi162 running (8m) 53s ago 8m 40.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 45df618ba8fc 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 smithi018 running (7m) 52s ago 7m 48.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 f91a40202467 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 smithi150 running (7m) 53s ago 7m 45.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e97a463b48bb 2024-09-19T08:45:04.837 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 smithi162 running (6m) 53s ago 6m 47.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 03bd6494c31b 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 smithi018 running (6m) 52s ago 6m 53.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3fa15c94e0fd 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 smithi150 running (5m) 53s ago 5m 41.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bf6676c500c6 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 smithi162 running (5m) 53s ago 5m 47.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 261db353f8b2 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 smithi018 running (4m) 52s ago 4m 50.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 5c0862828171 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 smithi150 running (4m) 53s ago 4m 55.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 56712fb5dbfa 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 smithi162 running (4m) 53s ago 4m 51.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 cafe214cce39 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 smithi018 running (3m) 52s ago 3m 51.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 96c6d03e81a3 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 smithi150 running (3m) 53s ago 3m 50.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6d1be801bb1c 2024-09-19T08:45:04.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 smithi162 running (2m) 53s ago 2m 41.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 8fc4f53d1a6a 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5f140a3300 msgr2=0x7f5f140a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5f140a3300 0x7f5f140a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c000f80 tx=0x7f5f1c031000 comp rx=0 tx=0).stop 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 msgr2=0x7f5f2c19e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c19e900 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000d770 tx=0x7f5f2000dc30 comp rx=0 tx=0).stop 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 shutdown_connections 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5f140a3300 0x7f5f140a57c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f2c10e1e0 0x7f5f2c1a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c076220 0x7f5f2c19e900 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 --2- 172.21.15.18:0/3278469883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f2c074c50 0x7f5f2c19e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:04.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 >> 172.21.15.18:0/3278469883 conn(0x7f5f2c0fd390 msgr2=0x7f5f2c0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:04.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 shutdown_connections 2024-09-19T08:45:04.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:04.837+0000 7f5f334ad640 1 -- 172.21.15.18:0/3278469883 wait complete. 2024-09-19T08:45:05.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:05 smithi018 ceph-mon[30956]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:05.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T08:45:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:05 smithi162 ceph-mon[34870]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:05.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:05 smithi150 ceph-mon[34610]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 -- 172.21.15.18:0/4261532487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50102700 msgr2=0x7f6f50104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 --2- 172.21.15.18:0/4261532487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50102700 0x7f6f50104af0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009900 tx=0x7f6f4c02a410 comp rx=0 tx=0).stop 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 -- 172.21.15.18:0/4261532487 shutdown_connections 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 --2- 172.21.15.18:0/4261532487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f50107960 0x7f6f50109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 --2- 172.21.15.18:0/4261532487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50105030 0x7f6f50107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 --2- 172.21.15.18:0/4261532487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50102700 0x7f6f50104af0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 -- 172.21.15.18:0/4261532487 >> 172.21.15.18:0/4261532487 conn(0x7f6f500fc2a0 msgr2=0x7f6f500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 -- 172.21.15.18:0/4261532487 shutdown_connections 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.347+0000 7f6f5774e640 1 -- 172.21.15.18:0/4261532487 wait complete. 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 Processor -- start 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 -- start start 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f50102700 0x7f6f50197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 0x7f6f50198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50107960 0x7f6f5019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5010d750 con 0x7f6f50105030 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5010d5d0 con 0x7f6f50102700 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f5774e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5010d8d0 con 0x7f6f50107960 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f54ce9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 0x7f6f50198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f54ce9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 0x7f6f50198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45308/0 (socket says 172.21.15.18:45308) 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f54ce9640 1 -- 172.21.15.18:0/1325899968 learned_addr learned my addr 172.21.15.18:0/1325899968 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f554ea640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f50102700 0x7f6f50197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.348+0000 7f6f55ceb640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50107960 0x7f6f5019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f54ce9640 1 -- 172.21.15.18:0/1325899968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50107960 msgr2=0x7f6f5019f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f54ce9640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50107960 0x7f6f5019f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f54ce9640 1 -- 172.21.15.18:0/1325899968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f50102700 msgr2=0x7f6f50197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f54ce9640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f50102700 0x7f6f50197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f54ce9640 1 -- 172.21.15.18:0/1325899968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5019fa30 con 0x7f6f50105030 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f55ceb640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50107960 0x7f6f5019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f54ce9640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 0x7f6f50198340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c970 tx=0x7f6f4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40014070 con 0x7f6f50105030 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5019fd20 con 0x7f6f50105030 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f40004440 con 0x7f6f50105030 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40003e50 con 0x7f6f50105030 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.349+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f501a0200 con 0x7f6f50105030 2024-09-19T08:45:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.350+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f500fdd90 con 0x7f6f50105030 2024-09-19T08:45:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.351+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6f40017070 con 0x7f6f50105030 2024-09-19T08:45:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.352+0000 7f6f467fc640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6f3c0a34a0 0x7f6f3c0a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.352+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f6f400cf960 con 0x7f6f50105030 2024-09-19T08:45:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.352+0000 7f6f554ea640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6f3c0a34a0 0x7f6f3c0a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.352+0000 7f6f554ea640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6f3c0a34a0 0x7f6f3c0a5960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006010 tx=0x7f6f4c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.356+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f4001e030 con 0x7f6f50105030 2024-09-19T08:45:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.540+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f6f50062630 con 0x7f6f3c0a34a0 2024-09-19T08:45:06.541 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:06 smithi018 ceph-mon[30956]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.546+0000 7f6f467fc640 1 -- 172.21.15.18:0/1325899968 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f6f50062630 con 0x7f6f3c0a34a0 2024-09-19T08:45:06.546 INFO:teuthology.orchestra.run.smithi018.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T08:45:06.546 INFO:teuthology.orchestra.run.smithi018.stdout:mds.all 12/12 55s ago 2m smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T08:45:06.546 INFO:teuthology.orchestra.run.smithi018.stdout:mgr 3/3 55s ago 7m smithi018=x;smithi150=y;smithi162=z;count:3 2024-09-19T08:45:06.546 INFO:teuthology.orchestra.run.smithi018.stdout:mon 3/3 55s ago 8m smithi018:172.21.15.18=a;smithi150:172.21.15.150=b;smithi162:172.21.15.162=c;count:3 2024-09-19T08:45:06.546 INFO:teuthology.orchestra.run.smithi018.stdout:osd 12 55s ago - 2024-09-19T08:45:06.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6f3c0a34a0 msgr2=0x7f6f3c0a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:06.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6f3c0a34a0 0x7f6f3c0a5960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006010 tx=0x7f6f4c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 msgr2=0x7f6f50198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:06.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 0x7f6f50198340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c970 tx=0x7f6f4000ce30 comp rx=0 tx=0).stop 2024-09-19T08:45:06.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 shutdown_connections 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6f3c0a34a0 0x7f6f3c0a5960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f50107960 0x7f6f5019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f50105030 0x7f6f50198340 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 --2- 172.21.15.18:0/1325899968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f50102700 0x7f6f50197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 >> 172.21.15.18:0/1325899968 conn(0x7f6f500fc2a0 msgr2=0x7f6f501030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 shutdown_connections 2024-09-19T08:45:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:06.548+0000 7f6f5774e640 1 -- 172.21.15.18:0/1325899968 wait complete. 2024-09-19T08:45:06.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:06 smithi162 ceph-mon[34870]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:06.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:06 smithi150 ceph-mon[34610]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:07.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T08:45:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:07.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:07 smithi018 ceph-mon[30956]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:07.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:07 smithi018 ceph-mon[30956]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:07.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:07 smithi150 ceph-mon[34610]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:07.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:07 smithi150 ceph-mon[34610]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:07.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:07 smithi162 ceph-mon[34870]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:07 smithi162 ceph-mon[34870]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 -- 172.21.15.18:0/95189182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 msgr2=0x7f17d4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 --2- 172.21.15.18:0/95189182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d4109d50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009ca0 tx=0x7f17cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 -- 172.21.15.18:0/95189182 shutdown_connections 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 --2- 172.21.15.18:0/95189182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d4109d50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 --2- 172.21.15.18:0/95189182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4105030 0x7f17d4107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 --2- 172.21.15.18:0/95189182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17d4102700 0x7f17d4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 -- 172.21.15.18:0/95189182 >> 172.21.15.18:0/95189182 conn(0x7f17d40fc2a0 msgr2=0x7f17d40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 -- 172.21.15.18:0/95189182 shutdown_connections 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 -- 172.21.15.18:0/95189182 wait complete. 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.068+0000 7f17d99b2640 1 Processor -- start 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 -- start start 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17d4102700 0x7f17d4197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4105030 0x7f17d41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d419f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17d410d7c0 con 0x7f17d4107960 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17d410d640 con 0x7f17d4105030 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d99b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17d410d940 con 0x7f17d4102700 2024-09-19T08:45:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d419f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d419f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45330/0 (socket says 172.21.15.18:45330) 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 -- 172.21.15.18:0/2101395295 learned_addr learned my addr 172.21.15.18:0/2101395295 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d2ffd640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17d4102700 0x7f17d4197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d27fc640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4105030 0x7f17d41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 -- 172.21.15.18:0/2101395295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17d4102700 msgr2=0x7f17d4197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17d4102700 0x7f17d4197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 -- 172.21.15.18:0/2101395295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4105030 msgr2=0x7f17d41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4105030 0x7f17d41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.069+0000 7f17d37fe640 1 -- 172.21.15.18:0/2101395295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d419f9e0 con 0x7f17d4107960 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.070+0000 7f17d37fe640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d419f370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f17cc031040 tx=0x7f17cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.070+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc032ec0 con 0x7f17d4107960 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.070+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17cc0044f0 con 0x7f17d4107960 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.070+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d419fc70 con 0x7f17d4107960 2024-09-19T08:45:08.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.070+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc030c30 con 0x7f17d4107960 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.070+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d41a01b0 con 0x7f17d4107960 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.071+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d40fdd90 con 0x7f17d4107960 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.072+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f17cc004040 con 0x7f17d4107960 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.073+0000 7f17d89b0640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f17bc0a34a0 0x7f17bc0a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.073+0000 7f17d2ffd640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f17bc0a34a0 0x7f17bc0a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.073+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f17cc0f1270 con 0x7f17d4107960 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.073+0000 7f17d2ffd640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f17bc0a34a0 0x7f17bc0a5960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f17c4005fd0 tx=0x7f17c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:08.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.077+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f17cc0bdb80 con 0x7f17d4107960 2024-09-19T08:45:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.259+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f17d4062630 con 0x7f17bc0a34a0 2024-09-19T08:45:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.261+0000 7f17d89b0640 1 -- 172.21.15.18:0/2101395295 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f17d4062630 con 0x7f17bc0a34a0 2024-09-19T08:45:08.261 INFO:teuthology.orchestra.run.smithi018.stdout:HOST ADDR LABELS STATUS 2024-09-19T08:45:08.261 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 172.21.15.18 2024-09-19T08:45:08.261 INFO:teuthology.orchestra.run.smithi018.stdout:smithi150 172.21.15.150 2024-09-19T08:45:08.261 INFO:teuthology.orchestra.run.smithi018.stdout:smithi162 172.21.15.162 2024-09-19T08:45:08.261 INFO:teuthology.orchestra.run.smithi018.stdout:3 hosts in cluster 2024-09-19T08:45:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f17bc0a34a0 msgr2=0x7f17bc0a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f17bc0a34a0 0x7f17bc0a5960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f17c4005fd0 tx=0x7f17c400b390 comp rx=0 tx=0).stop 2024-09-19T08:45:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 msgr2=0x7f17d419f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d419f370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f17cc031040 tx=0x7f17cc003ba0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 shutdown_connections 2024-09-19T08:45:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f17bc0a34a0 0x7f17bc0a5960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d4107960 0x7f17d419f370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4105030 0x7f17d41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 --2- 172.21.15.18:0/2101395295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17d4102700 0x7f17d4197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 >> 172.21.15.18:0/2101395295 conn(0x7f17d40fc2a0 msgr2=0x7f17d4102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 shutdown_connections 2024-09-19T08:45:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:08.263+0000 7f17d99b2640 1 -- 172.21.15.18:0/2101395295 wait complete. 2024-09-19T08:45:09.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T08:45:09.355 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:09 smithi018 ceph-mon[30956]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:09.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:09 smithi018 ceph-mon[30956]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:09 smithi150 ceph-mon[34610]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:09.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:09 smithi150 ceph-mon[34610]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.846+0000 7fdb8aadf640 1 -- 172.21.15.18:0/2731983092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 msgr2=0x7fdb8410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.846+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/2731983092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb8410a050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009ca0 tx=0x7fdb7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- 172.21.15.18:0/2731983092 shutdown_connections 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/2731983092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb8410a050 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/2731983092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 0x7fdb84103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/2731983092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb84101c00 0x7fdb84102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- 172.21.15.18:0/2731983092 >> 172.21.15.18:0/2731983092 conn(0x7fdb840fd390 msgr2=0x7fdb840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- 172.21.15.18:0/2731983092 shutdown_connections 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- 172.21.15.18:0/2731983092 wait complete. 2024-09-19T08:45:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 Processor -- start 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- start start 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb84101c00 0x7fdb84075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 0x7fdb840745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb84074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410d710 con 0x7fdb841037c0 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410d590 con 0x7fdb84101c00 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.847+0000 7fdb8aadf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410d890 con 0x7fdb84102e00 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb84074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb84074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36482/0 (socket says 172.21.15.18:36482) 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 -- 172.21.15.18:0/322948386 learned_addr learned my addr 172.21.15.18:0/322948386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb83fff640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 0x7fdb840745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8887b640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb84101c00 0x7fdb84075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 -- 172.21.15.18:0/322948386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 msgr2=0x7fdb840745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 0x7fdb840745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 -- 172.21.15.18:0/322948386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb84101c00 msgr2=0x7fdb84075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb84101c00 0x7fdb84075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 -- 172.21.15.18:0/322948386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb840753e0 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb83fff640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 0x7fdb840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8907c640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb84074b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009dc0 tx=0x7fdb7c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c032ec0 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb7c0044f0 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb841a1f00 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.848+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c030d40 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.849+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841a23b0 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.850+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb841090a0 con 0x7fdb841037c0 2024-09-19T08:45:09.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.851+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb7c004040 con 0x7fdb841037c0 2024-09-19T08:45:09.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.852+0000 7fdb81ffb640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdb740a3470 0x7fdb740a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.852+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdb7c0f1500 con 0x7fdb841037c0 2024-09-19T08:45:09.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.852+0000 7fdb8887b640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdb740a3470 0x7fdb740a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.852+0000 7fdb8887b640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdb740a3470 0x7fdb740a5930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb78005fd0 tx=0x7fdb78005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:09.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:09.855+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb7c0bde70 con 0x7fdb841037c0 2024-09-19T08:45:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:09 smithi162 ceph-mon[34870]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:09.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:09 smithi162 ceph-mon[34870]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:10.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.039+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 --> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fdb84062630 con 0x7fdb740a3470 2024-09-19T08:45:10.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.041+0000 7fdb81ffb640 1 -- 172.21.15.18:0/322948386 <== mgr.14150 v2:172.21.15.18:6800/2747026181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fdb84062630 con 0x7fdb740a3470 2024-09-19T08:45:10.041 INFO:teuthology.orchestra.run.smithi018.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T08:45:10.041 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T08:45:10.041 INFO:teuthology.orchestra.run.smithi018.stdout:smithi150 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GX400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T08:45:10.041 INFO:teuthology.orchestra.run.smithi018.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:45:10.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdb740a3470 msgr2=0x7fdb740a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:10.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdb740a3470 0x7fdb740a5930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb78005fd0 tx=0x7fdb78005850 comp rx=0 tx=0).stop 2024-09-19T08:45:10.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 msgr2=0x7fdb84074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:10.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb84074b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009dc0 tx=0x7fdb7c003ba0 comp rx=0 tx=0).stop 2024-09-19T08:45:10.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 shutdown_connections 2024-09-19T08:45:10.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdb740a3470 0x7fdb740a5930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:10.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb841037c0 0x7fdb84074b20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:10.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb84102e00 0x7fdb840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:10.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 --2- 172.21.15.18:0/322948386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb84101c00 0x7fdb84075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:10.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 >> 172.21.15.18:0/322948386 conn(0x7fdb840fd390 msgr2=0x7fdb84106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:10.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 shutdown_connections 2024-09-19T08:45:10.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:10.043+0000 7fdb8aadf640 1 -- 172.21.15.18:0/322948386 wait complete. 2024-09-19T08:45:10.879 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:45:10.891 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:45:10.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:45:11.159 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:11.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:11 smithi018 ceph-mon[30956]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:11.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:11 smithi018 ceph-mon[30956]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:11.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 -- 172.21.15.18:0/989824843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 msgr2=0x7f33481073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 --2- 172.21.15.18:0/989824843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f33481073c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f333c009900 tx=0x7f333c02a410 comp rx=0 tx=0).stop 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 -- 172.21.15.18:0/989824843 shutdown_connections 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 --2- 172.21.15.18:0/989824843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 0x7f3348109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 --2- 172.21.15.18:0/989824843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f33481073c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 --2- 172.21.15.18:0/989824843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33481026a0 0x7f3348104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 -- 172.21.15.18:0/989824843 >> 172.21.15.18:0/989824843 conn(0x7f33480fc2a0 msgr2=0x7f33480fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 -- 172.21.15.18:0/989824843 shutdown_connections 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.621+0000 7f334e771640 1 -- 172.21.15.18:0/989824843 wait complete. 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 Processor -- start 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 -- start start 2024-09-19T08:45:11.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33481026a0 0x7f3348102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f3348100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 0x7f3348100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f334810d730 con 0x7f3348104fd0 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f334810d5b0 con 0x7f3348107900 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334e771640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f334810d8b0 con 0x7f33481026a0 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f33477fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f3348100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f33477fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f3348100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36498/0 (socket says 172.21.15.18:36498) 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f33477fe640 1 -- 172.21.15.18:0/1312574832 learned_addr learned my addr 172.21.15.18:0/1312574832 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f3347fff640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33481026a0 0x7f3348102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f334cd0e640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 0x7f3348100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:11.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f33477fe640 1 -- 172.21.15.18:0/1312574832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33481026a0 msgr2=0x7f3348102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.622+0000 7f33477fe640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33481026a0 0x7f3348102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33477fe640 1 -- 172.21.15.18:0/1312574832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 msgr2=0x7f3348100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33477fe640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 0x7f3348100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33477fe640 1 -- 172.21.15.18:0/1312574832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3348101450 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f334cd0e640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 0x7f3348100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33477fe640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f3348100650 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f333c0314e0 tx=0x7f333c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c03f030 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f333c003cb0 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33481a1f70 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c035070 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.623+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33481a2360 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.624+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33480fdd90 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.625+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f333c042030 con 0x7f3348104fd0 2024-09-19T08:45:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.626+0000 7f33457fa640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f33300a32d0 0x7f33300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.626+0000 7f3347fff640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f33300a32d0 0x7f33300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.626+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f333c0f07f0 con 0x7f3348104fd0 2024-09-19T08:45:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.626+0000 7f3347fff640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f33300a32d0 0x7f33300a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3338005d00 tx=0x7f333800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.629+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f333c0bd050 con 0x7f3348104fd0 2024-09-19T08:45:11.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:11 smithi150 ceph-mon[34610]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:11.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:11 smithi150 ceph-mon[34610]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:11.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.844+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f334802d7c0 con 0x7f3348104fd0 2024-09-19T08:45:11.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.845+0000 7f33457fa640 1 -- 172.21.15.18:0/1312574832 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3054 (secure 0 0 0) 0x7f333c0bc950 con 0x7f3348104fd0 2024-09-19T08:45:11.845 INFO:teuthology.orchestra.run.smithi018.stdout:e21 2024-09-19T08:45:11.845 INFO:teuthology.orchestra.run.smithi018.stdout:btime 2024-09-19T08:43:56:628067+0000 2024-09-19T08:45:11.845 INFO:teuthology.orchestra.run.smithi018.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:45:11.845 INFO:teuthology.orchestra.run.smithi018.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:legacy client fscid: 1 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:Filesystem 'cephfs' (1) 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:fs_name cephfs 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 21 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-19T08:43:14.179526+0000 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-19T08:43:56.358444+0000 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:tableserver 0 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:root 0 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:session_timeout 300 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:session_autoclose 300 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:max_file_size 1099511627776 2024-09-19T08:45:11.846 INFO:teuthology.orchestra.run.smithi018.stdout:max_xattr_size 65536 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:required_client_features {} 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure 0 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure_osd_epoch 0 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:max_mds 1 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:in 0 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:up {0=24497} 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:failed 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:damaged 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:stopped 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:data_pools [3,4] 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:metadata_pool 2 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:inline_data disabled 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:balancer 2024-09-19T08:45:11.847 INFO:teuthology.orchestra.run.smithi018.stdout:bal_rank_mask -1 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:standby_count_wanted 0 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:qdb_cluster leader: 24497 members: 24497 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b{0:24497} state up:active seq 4 addr [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.i{0:24493} state up:standby-replay seq 1 addr [v2:172.21.15.162:6838/1612914765,v1:172.21.15.162:6839/1612914765] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:Standby daemons: 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.j{-1:14556} state up:standby seq 1 addr [v2:172.21.15.18:6834/3031578467,v1:172.21.15.18:6835/3031578467] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d{-1:14568} state up:standby seq 1 addr [v2:172.21.15.18:6836/1252489164,v1:172.21.15.18:6837/1252489164] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.g{-1:14619} state up:standby seq 1 addr [v2:172.21.15.18:6838/2535601572,v1:172.21.15.18:6839/2535601572] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a{-1:14631} state up:standby seq 1 addr [v2:172.21.15.18:6840/2703044208,v1:172.21.15.18:6841/2703044208] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.848 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.k{-1:24413} state up:standby seq 1 addr [v2:172.21.15.150:6832/444164547,v1:172.21.15.150:6833/444164547] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.849 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.l{-1:24433} state up:standby seq 1 addr [v2:172.21.15.162:6832/365177303,v1:172.21.15.162:6833/365177303] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.849 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.e{-1:24440} state up:standby seq 1 addr [v2:172.21.15.150:6834/1640401494,v1:172.21.15.150:6835/1640401494] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.849 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.h{-1:24467} state up:standby seq 1 addr [v2:172.21.15.150:6836/4142212267,v1:172.21.15.150:6837/4142212267] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.849 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.f{-1:24475} state up:standby seq 1 addr [v2:172.21.15.162:6834/1358504663,v1:172.21.15.162:6835/1358504663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.849 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c{-1:24481} state up:standby seq 1 addr [v2:172.21.15.162:6836/1673736913,v1:172.21.15.162:6837/1673736913] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:45:11.849 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f33300a32d0 msgr2=0x7f33300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f33300a32d0 0x7f33300a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3338005d00 tx=0x7f333800b410 comp rx=0 tx=0).stop 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 msgr2=0x7f3348100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f3348100650 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f333c0314e0 tx=0x7f333c0042e0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 shutdown_connections 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f33300a32d0 0x7f33300a5790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3348107900 0x7f3348100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3348104fd0 0x7f3348100650 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 --2- 172.21.15.18:0/1312574832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33481026a0 0x7f3348102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 >> 172.21.15.18:0/1312574832 conn(0x7f33480fc2a0 msgr2=0x7f33481030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:11.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 shutdown_connections 2024-09-19T08:45:11.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:11.847+0000 7f334e771640 1 -- 172.21.15.18:0/1312574832 wait complete. 2024-09-19T08:45:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:11 smithi162 ceph-mon[34870]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:11 smithi162 ceph-mon[34870]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:12.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:12 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1312574832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:45:12.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T08:45:12.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:12 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1312574832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:45:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:12.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:12 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1312574832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:45:13.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 -- 172.21.15.18:0/1868735203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac701078c0 msgr2=0x7fac70109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 --2- 172.21.15.18:0/1868735203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac701078c0 0x7fac70109d10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac68009900 tx=0x7fac6802a410 comp rx=0 tx=0).stop 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 -- 172.21.15.18:0/1868735203 shutdown_connections 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 --2- 172.21.15.18:0/1868735203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac701078c0 0x7fac70109d10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 --2- 172.21.15.18:0/1868735203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac70104f90 0x7fac70107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 --2- 172.21.15.18:0/1868735203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70102660 0x7fac70104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 -- 172.21.15.18:0/1868735203 >> 172.21.15.18:0/1868735203 conn(0x7fac700fc280 msgr2=0x7fac700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 -- 172.21.15.18:0/1868735203 shutdown_connections 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 -- 172.21.15.18:0/1868735203 wait complete. 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 Processor -- start 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.371+0000 7fac783ab640 1 -- start start 2024-09-19T08:45:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 0x7fac70101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70104f90 0x7fac70100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac701078c0 0x7fac70100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac7010d790 con 0x7fac70102660 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac7010d610 con 0x7fac701078c0 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac7010d910 con 0x7fac70104f90 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 0x7fac70101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 0x7fac70101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36530/0 (socket says 172.21.15.18:36530) 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 -- 172.21.15.18:0/1773684040 learned_addr learned my addr 172.21.15.18:0/1773684040 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac75946640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70104f90 0x7fac70100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76948640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac701078c0 0x7fac70100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 -- 172.21.15.18:0/1773684040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70104f90 msgr2=0x7fac70100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70104f90 0x7fac70100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 -- 172.21.15.18:0/1773684040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac701078c0 msgr2=0x7fac70100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac701078c0 0x7fac70100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 -- 172.21.15.18:0/1773684040 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac70101410 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac76147640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 0x7fac70101fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00ba50 tx=0x7fac6c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c019070 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac6c00cbe0 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac701a1fa0 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.372+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0075d0 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.373+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac701a2480 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.374+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac700fdd70 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.375+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac6c01c070 con 0x7fac70102660 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.375+0000 7fac637fe640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac5c0a32d0 0x7fac5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:13.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.375+0000 7fac75946640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac5c0a32d0 0x7fac5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:13.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.375+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fac6c0cf350 con 0x7fac70102660 2024-09-19T08:45:13.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.376+0000 7fac75946640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac5c0a32d0 0x7fac5c0a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac70101d40 tx=0x7fac6400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:13.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.379+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac6c09bcc0 con 0x7fac70102660 2024-09-19T08:45:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.600+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fac70062df0 con 0x7fac70102660 2024-09-19T08:45:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:13 smithi018 ceph-mon[30956]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.602+0000 7fac637fe640 1 -- 172.21.15.18:0/1773684040 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5609 (secure 0 0 0) 0x7fac6c09b5c0 con 0x7fac70102660 2024-09-19T08:45:13.602 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 88 2024-09-19T08:45:13.602 INFO:teuthology.orchestra.run.smithi018.stdout:fsid ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:45:13.602 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-19T08:35:30.772382+0000 2024-09-19T08:45:13.602 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-19T08:44:19.297394+0000 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 27 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client luminous 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release squid 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-19T08:45:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 12 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6802/2521385669,v1:172.21.15.18:6803/2521385669] [v2:172.21.15.18:6804/2521385669,v1:172.21.15.18:6805/2521385669] exists,up 0bb67065-1994-4aa0-92e0-3777a2054efe 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6800/1031941891,v1:172.21.15.150:6801/1031941891] [v2:172.21.15.150:6802/1031941891,v1:172.21.15.150:6803/1031941891] exists,up 8bbf03fb-7094-4991-a237-e388fbb0d949 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/1472595210,v1:172.21.15.162:6801/1472595210] [v2:172.21.15.162:6802/1472595210,v1:172.21.15.162:6803/1472595210] exists,up b6aeae03-d039-4b95-bdf4-7484fba94e91 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 24 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6810/830246499,v1:172.21.15.18:6811/830246499] [v2:172.21.15.18:6812/830246499,v1:172.21.15.18:6813/830246499] exists,up 0df42fcd-03dc-4b16-b8fb-f1d74227e211 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 31 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6808/3531191776,v1:172.21.15.150:6809/3531191776] [v2:172.21.15.150:6810/3531191776,v1:172.21.15.150:6811/3531191776] exists,up 4942de51-8d38-4707-a4ba-d72fa75043d4 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 36 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/2688421502,v1:172.21.15.162:6809/2688421502] [v2:172.21.15.162:6810/2688421502,v1:172.21.15.162:6811/2688421502] exists,up 3148eeed-0f5a-4d80-8a3d-28d34ce6be50 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 43 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6818/3727051065,v1:172.21.15.18:6819/3727051065] [v2:172.21.15.18:6820/3727051065,v1:172.21.15.18:6821/3727051065] exists,up a4e2e48e-dfd9-4f77-8260-54a8e0385543 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 47 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6816/2823141522,v1:172.21.15.150:6817/2823141522] [v2:172.21.15.150:6818/2823141522,v1:172.21.15.150:6819/2823141522] exists,up a954f75a-ad76-4749-893b-6e30cafcb75a 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 up in weight 1 up_from 54 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/2409536118,v1:172.21.15.162:6817/2409536118] [v2:172.21.15.162:6818/2409536118,v1:172.21.15.162:6819/2409536118] exists,up 274f4216-c240-4033-993b-3ff22db0fcb8 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 up in weight 1 up_from 62 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6826/4029412965,v1:172.21.15.18:6827/4029412965] [v2:172.21.15.18:6828/4029412965,v1:172.21.15.18:6829/4029412965] exists,up 8d898bb9-3d1f-4650-8419-c381984ff968 2024-09-19T08:45:13.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 up in weight 1 up_from 67 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6824/1892479254,v1:172.21.15.150:6825/1892479254] [v2:172.21.15.150:6826/1892479254,v1:172.21.15.150:6827/1892479254] exists,up 06c9dfa6-9639-4595-9bb6-3662c207ac22 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 up in weight 1 up_from 74 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/3933246322,v1:172.21.15.162:6825/3933246322] [v2:172.21.15.162:6826/3933246322,v1:172.21.15.162:6827/3933246322] exists,up f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.0 [7,11] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.b [2,4] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.e [2,4] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.1f [8,1] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.c [3,9] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.17 [4,6] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1b [4,8] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.36 [4,9] 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2071748034 expires 2024-09-20T08:36:17.763015+0000 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2416383067 expires 2024-09-20T08:36:17.763015+0000 2024-09-19T08:45:13.605 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/4188004415 expires 2024-09-20T08:36:17.763015+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2457973928 expires 2024-09-20T08:36:17.763015+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/1687208170 expires 2024-09-20T08:35:53.066097+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/4200011478 expires 2024-09-20T08:35:53.066097+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/338127021 expires 2024-09-20T08:35:53.066097+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/4188004415 expires 2024-09-20T08:36:17.763015+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/1687208170 expires 2024-09-20T08:35:53.066097+0000 2024-09-19T08:45:13.606 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3236542074 expires 2024-09-20T08:35:53.066097+0000 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac5c0a32d0 msgr2=0x7fac5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac5c0a32d0 0x7fac5c0a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac70101d40 tx=0x7fac6400a4c0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 msgr2=0x7fac70101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 0x7fac70101fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00ba50 tx=0x7fac6c00bf10 comp rx=0 tx=0).stop 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 shutdown_connections 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fac5c0a32d0 0x7fac5c0a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac701078c0 0x7fac70100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70104f90 0x7fac70100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 --2- 172.21.15.18:0/1773684040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70102660 0x7fac70101fc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 >> 172.21.15.18:0/1773684040 conn(0x7fac700fc280 msgr2=0x7fac70102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 shutdown_connections 2024-09-19T08:45:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:13.604+0000 7fac783ab640 1 -- 172.21.15.18:0/1773684040 wait complete. 2024-09-19T08:45:13.728 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:13 smithi162 ceph-mon[34870]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:13.728 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:13 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:13.729 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:13 smithi150 ceph-mon[34610]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:13.729 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:13 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:14.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:14 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1773684040' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:45:14.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:14 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1773684040' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:45:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:14 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:14 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1773684040' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:45:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:14 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:14.945 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T08:45:14.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:45:15.238 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:15.613 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:15 smithi018 ceph-mon[30956]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 -- 172.21.15.18:0/999280348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 msgr2=0x7fc004103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 --2- 172.21.15.18:0/999280348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004103110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009930 tx=0x7fbff402a420 comp rx=0 tx=0).stop 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 -- 172.21.15.18:0/999280348 shutdown_connections 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 --2- 172.21.15.18:0/999280348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 0x7fc00410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 --2- 172.21.15.18:0/999280348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0041036e0 0x7fc004107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 --2- 172.21.15.18:0/999280348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004103110 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 -- 172.21.15.18:0/999280348 >> 172.21.15.18:0/999280348 conn(0x7fc0040fc7d0 msgr2=0x7fc0040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 -- 172.21.15.18:0/999280348 shutdown_connections 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.696+0000 7fc00889e640 1 -- 172.21.15.18:0/999280348 wait complete. 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 Processor -- start 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 -- start start 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0041036e0 0x7fc004100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 0x7fc004101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc004111f50 con 0x7fc004102d30 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.697+0000 7fc00889e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc004111dd0 con 0x7fc0041082a0 2024-09-19T08:45:15.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00889e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0041120d0 con 0x7fc0041036e0 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36544/0 (socket says 172.21.15.18:36544) 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 -- 172.21.15.18:0/2593360649 learned_addr learned my addr 172.21.15.18:0/2593360649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc001d9b640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0041036e0 0x7fc004100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc002d9d640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 0x7fc004101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 -- 172.21.15.18:0/2593360649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0041036e0 msgr2=0x7fc004100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0041036e0 0x7fc004100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 -- 172.21.15.18:0/2593360649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 msgr2=0x7fc004101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:15.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 0x7fc004101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 -- 172.21.15.18:0/2593360649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041a69d0 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc002d9d640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 0x7fc004101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fc00259c640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004100990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbff4004770 tx=0x7fbff40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.698+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff403f070 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.699+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbff403b460 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.699+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0041a6c60 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.699+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4035070 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.699+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0041a7140 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.700+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc004103110 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.701+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbff403b610 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.702+0000 7fbff37fe640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfec0a32d0 0x7fbfec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.702+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fbff40f0460 con 0x7fc004102d30 2024-09-19T08:45:15.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.702+0000 7fc001d9b640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfec0a32d0 0x7fbfec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:15.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.702+0000 7fc001d9b640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfec0a32d0 0x7fbfec0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc004102420 tx=0x7fbff800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:15.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.705+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbff40bcc60 con 0x7fc004102d30 2024-09-19T08:45:15.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:15 smithi150 ceph-mon[34610]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:15 smithi162 ceph-mon[34870]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.920+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc00410a2b0 con 0x7fc004102d30 2024-09-19T08:45:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.921+0000 7fbff37fe640 1 -- 172.21.15.18:0/2593360649 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fbff40bc560 con 0x7fc004102d30 2024-09-19T08:45:15.922 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:15.922 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:45:15.922 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:45:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfec0a32d0 msgr2=0x7fbfec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfec0a32d0 0x7fbfec0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc004102420 tx=0x7fbff800b410 comp rx=0 tx=0).stop 2024-09-19T08:45:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 msgr2=0x7fc004100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004100990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbff4004770 tx=0x7fbff40042f0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 shutdown_connections 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfec0a32d0 0x7fbfec0a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0041082a0 0x7fc004101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0041036e0 0x7fc004100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 --2- 172.21.15.18:0/2593360649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc004102d30 0x7fc004100990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 >> 172.21.15.18:0/2593360649 conn(0x7fc0040fc7d0 msgr2=0x7fc004105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.923+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 shutdown_connections 2024-09-19T08:45:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:15.924+0000 7fc00889e640 1 -- 172.21.15.18:0/2593360649 wait complete. 2024-09-19T08:45:16.593 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.593 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.593 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:16 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2593360649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:16.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:16.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:16.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:45:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:16 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2593360649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:16.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.879 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:16 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2593360649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:45:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 -- 172.21.15.18:0/535251664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854106f10 msgr2=0x7f385410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 --2- 172.21.15.18:0/535251664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854106f10 0x7f385410ea90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f384c009ca0 tx=0x7f384c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 -- 172.21.15.18:0/535251664 shutdown_connections 2024-09-19T08:45:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 --2- 172.21.15.18:0/535251664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854106f10 0x7f385410ea90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 --2- 172.21.15.18:0/535251664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3854102790 0x7f38541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 --2- 172.21.15.18:0/535251664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 0x7f38541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 -- 172.21.15.18:0/535251664 >> 172.21.15.18:0/535251664 conn(0x7f38540fd8c0 msgr2=0x7f38540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 -- 172.21.15.18:0/535251664 shutdown_connections 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 -- 172.21.15.18:0/535251664 wait complete. 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 Processor -- start 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.354+0000 7f385c295640 1 -- start start 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 0x7f3854198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3854106f10 0x7f385419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111ec0 con 0x7f3854102790 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111d40 con 0x7f3854101de0 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3854112040 con 0x7f3854106f10 2024-09-19T08:45:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36566/0 (socket says 172.21.15.18:36566) 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 -- 172.21.15.18:0/1595387963 learned_addr learned my addr 172.21.15.18:0/1595387963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385a031640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 0x7f3854198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385a832640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3854106f10 0x7f385419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 -- 172.21.15.18:0/1595387963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3854106f10 msgr2=0x7f385419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3854106f10 0x7f385419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 -- 172.21.15.18:0/1595387963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 msgr2=0x7f3854198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 0x7f3854198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 -- 172.21.15.18:0/1595387963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385419d430 con 0x7f3854102790 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385a031640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 0x7f3854198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f3859830640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541989c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f384400b4a0 tx=0x7f384400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844014070 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385419d720 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3844010ac0 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844017c30 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.355+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38541a5000 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.356+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38541021c0 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.358+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3844017070 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.358+0000 7f384b7fe640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f38400a32d0 0x7f38400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.358+0000 7f385a031640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f38400a32d0 0x7f38400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.358+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f38440cf480 con 0x7f3854102790 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.359+0000 7f385a031640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f38400a32d0 0x7f38400a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3850006fd0 tx=0x7f3850008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:17.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.362+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f384409bdf0 con 0x7f3854102790 2024-09-19T08:45:17.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.575+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f385410a150 con 0x7f3854102790 2024-09-19T08:45:17.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.576+0000 7f384b7fe640 1 -- 172.21.15.18:0/1595387963 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f384409b6f0 con 0x7f3854102790 2024-09-19T08:45:17.577 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:45:17.577 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.578+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f38400a32d0 msgr2=0x7f38400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.578+0000 7f385c295640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f38400a32d0 0x7f38400a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3850006fd0 tx=0x7f3850008040 comp rx=0 tx=0).stop 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.578+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 msgr2=0x7f38541989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.578+0000 7f385c295640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541989c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f384400b4a0 tx=0x7f384400b960 comp rx=0 tx=0).stop 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 shutdown_connections 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f38400a32d0 0x7f38400a5790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3854106f10 0x7f385419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541989c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 --2- 172.21.15.18:0/1595387963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3854101de0 0x7f3854198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 >> 172.21.15.18:0/1595387963 conn(0x7f38540fd8c0 msgr2=0x7f38540fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 shutdown_connections 2024-09-19T08:45:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:17.579+0000 7f385c295640 1 -- 172.21.15.18:0/1595387963 wait complete. 2024-09-19T08:45:17.817 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:17 smithi150 ceph-mon[34610]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:17.893 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:17 smithi018 ceph-mon[30956]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:17 smithi162 ceph-mon[34870]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:45:18.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:45:18.472 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:18.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:18 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1595387963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:18.907 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]: dispatch 2024-09-19T08:45:18.907 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-19T08:45:18.907 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-09-19T08:45:18.907 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-19T08:45:18.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1595387963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:18.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]: dispatch 2024-09-19T08:45:18.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-19T08:45:18.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-09-19T08:45:18.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-19T08:45:18.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:18 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1595387963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:18.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]: dispatch 2024-09-19T08:45:18.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-19T08:45:18.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]: dispatch 2024-09-19T08:45:18.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-19T08:45:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 -- 172.21.15.18:0/342513406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301036e0 msgr2=0x7f9430107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 --2- 172.21.15.18:0/342513406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301036e0 0x7f9430107b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9424009930 tx=0x7f942402a420 comp rx=0 tx=0).stop 2024-09-19T08:45:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 -- 172.21.15.18:0/342513406 shutdown_connections 2024-09-19T08:45:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 --2- 172.21.15.18:0/342513406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94301082a0 0x7f943010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 --2- 172.21.15.18:0/342513406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301036e0 0x7f9430107b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 --2- 172.21.15.18:0/342513406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9430102d30 0x7f9430103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 -- 172.21.15.18:0/342513406 >> 172.21.15.18:0/342513406 conn(0x7f94300fc7d0 msgr2=0x7f94300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 -- 172.21.15.18:0/342513406 shutdown_connections 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.950+0000 7f94350d9640 1 -- 172.21.15.18:0/342513406 wait complete. 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.951+0000 7f94350d9640 1 Processor -- start 2024-09-19T08:45:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.951+0000 7f94350d9640 1 -- start start 2024-09-19T08:45:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9430102d30 0x7f9430100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94301036e0 0x7f9430100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 0x7f9430101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9430111f50 con 0x7f94301082a0 2024-09-19T08:45:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9430111dd0 con 0x7f94301036e0 2024-09-19T08:45:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94301120d0 con 0x7f9430102d30 2024-09-19T08:45:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 0x7f9430101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 0x7f9430101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36584/0 (socket says 172.21.15.18:36584) 2024-09-19T08:45:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 -- 172.21.15.18:0/1921244703 learned_addr learned my addr 172.21.15.18:0/1921244703 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942e59c640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94301036e0 0x7f9430100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942ed9d640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9430102d30 0x7f9430100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 -- 172.21.15.18:0/1921244703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9430102d30 msgr2=0x7f9430100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9430102d30 0x7f9430100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 -- 172.21.15.18:0/1921244703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94301036e0 msgr2=0x7f9430100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94301036e0 0x7f9430100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 -- 172.21.15.18:0/1921244703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94301a69b0 con 0x7f94301082a0 2024-09-19T08:45:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942ed9d640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9430102d30 0x7f9430100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:18.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f942f59e640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 0x7f9430101410 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f942800d750 tx=0x7f942800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:18.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428017070 con 0x7f94301082a0 2024-09-19T08:45:18.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301a6ca0 con 0x7f94301082a0 2024-09-19T08:45:18.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.952+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94280054d0 con 0x7f94301082a0 2024-09-19T08:45:18.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.953+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428004c60 con 0x7f94301082a0 2024-09-19T08:45:18.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.953+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301a71b0 con 0x7f94301082a0 2024-09-19T08:45:18.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.953+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943006a850 con 0x7f94301082a0 2024-09-19T08:45:18.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.955+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9428004e00 con 0x7f94301082a0 2024-09-19T08:45:18.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.955+0000 7f9417fff640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94180a3240 0x7f94180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:18.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.956+0000 7f942ed9d640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94180a3240 0x7f94180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:18.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.956+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9208+0+0 (secure 0 0 0) 0x7f94280cfa20 con 0x7f94301082a0 2024-09-19T08:45:18.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.956+0000 7f942ed9d640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94180a3240 0x7f94180a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9420007e70 tx=0x7f9420007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:18.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:18.959+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f942809c370 con 0x7f94301082a0 2024-09-19T08:45:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.138+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9430101ec0 con 0x7f94301082a0 2024-09-19T08:45:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.139+0000 7f9417fff640 1 -- 172.21.15.18:0/1921244703 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24907 (secure 0 0 0) 0x7f942809bc70 con 0x7f94301082a0 2024-09-19T08:45:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:45:19.142 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:45:18.548153+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:45:19.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.141+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94180a3240 msgr2=0x7f94180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.141+0000 7f94350d9640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94180a3240 0x7f94180a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9420007e70 tx=0x7f9420007850 comp rx=0 tx=0).stop 2024-09-19T08:45:19.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.141+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 msgr2=0x7f9430101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.141+0000 7f94350d9640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 0x7f9430101410 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f942800d750 tx=0x7f942800dc10 comp rx=0 tx=0).stop 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 shutdown_connections 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f94180a3240 0x7f94180a5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94301082a0 0x7f9430101410 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94301036e0 0x7f9430100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 --2- 172.21.15.18:0/1921244703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9430102d30 0x7f9430100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 >> 172.21.15.18:0/1921244703 conn(0x7f94300fc7d0 msgr2=0x7f9430106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 shutdown_connections 2024-09-19T08:45:19.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:19.142+0000 7f94350d9640 1 -- 172.21.15.18:0/1921244703 wait complete. 2024-09-19T08:45:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]': finished 2024-09-19T08:45:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-19T08:45:19.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]': finished 2024-09-19T08:45:19.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-19T08:45:19.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T08:45:19.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:45:19.816 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:19 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1921244703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]': finished 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]': finished 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:45:19.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:19 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1921244703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:45:19.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:43:14.179526+0000', 'modified': '2024-09-19T08:43:56.358444+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6839/1612914765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 1612914765}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 1612914765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.150:6839/3054116303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6838', 'nonce': 3054116303}, {'type': 'v1', 'addr': '172.21.15.150:6839', 'nonce': 3054116303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-19T08:45:19.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:45:19.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]': finished 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 8]}]': finished 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:45:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:19 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1921244703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:45:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 -- 172.21.15.18:0/843328974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 msgr2=0x7f5ee4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 --2- 172.21.15.18:0/843328974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee4100ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009930 tx=0x7f5ed402a420 comp rx=0 tx=0).stop 2024-09-19T08:45:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 -- 172.21.15.18:0/843328974 shutdown_connections 2024-09-19T08:45:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 --2- 172.21.15.18:0/843328974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ee4101420 0x7f5ee410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 --2- 172.21.15.18:0/843328974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee4100ee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 --2- 172.21.15.18:0/843328974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 0x7f5ee4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 -- 172.21.15.18:0/843328974 >> 172.21.15.18:0/843328974 conn(0x7f5ee40fc7a0 msgr2=0x7f5ee40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 -- 172.21.15.18:0/843328974 shutdown_connections 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.644+0000 7f5eec60c640 1 -- 172.21.15.18:0/843328974 wait complete. 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.645+0000 7f5eec60c640 1 Processor -- start 2024-09-19T08:45:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.645+0000 7f5eec60c640 1 -- start start 2024-09-19T08:45:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.645+0000 7f5eec60c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.645+0000 7f5eec60c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ee4101420 0x7f5ee41977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.645+0000 7f5eec60c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 0x7f5ee419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eec60c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4110d30 con 0x7f5ee4100a80 2024-09-19T08:45:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eec60c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4110bb0 con 0x7f5ee4101420 2024-09-19T08:45:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eec60c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4110eb0 con 0x7f5ee4106a80 2024-09-19T08:45:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee41972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44882/0 (socket says 172.21.15.18:44882) 2024-09-19T08:45:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 -- 172.21.15.18:0/773247611 learned_addr learned my addr 172.21.15.18:0/773247611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ee4101420 0x7f5ee41977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 0x7f5ee419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 -- 172.21.15.18:0/773247611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 msgr2=0x7f5ee419bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 0x7f5ee419bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 -- 172.21.15.18:0/773247611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ee4101420 msgr2=0x7f5ee41977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ee4101420 0x7f5ee41977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 -- 172.21.15.18:0/773247611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee419c260 con 0x7f5ee4100a80 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 0x7f5ee419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee41972b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009860 tx=0x7f5ee0009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5edb7fe640 1 -- 172.21.15.18:0/773247611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0005020 con 0x7f5ee4100a80 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5edb7fe640 1 -- 172.21.15.18:0/773247611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ee00047a0 con 0x7f5ee4100a80 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5edb7fe640 1 -- 172.21.15.18:0/773247611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0007b00 con 0x7f5ee4100a80 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee419c550 con 0x7f5ee4100a80 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.646+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee406a790 con 0x7f5ee4100a80 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.649+0000 7f5edb7fe640 1 -- 172.21.15.18:0/773247611 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5ee0007ca0 con 0x7f5ee4100a80 2024-09-19T08:45:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.649+0000 7f5eee9e5740 1 Processor -- start 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.649+0000 7f5eee9e5740 1 -- start start 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.649+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b349d0 0x55b958b34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.649+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b352f0 0x55b958b3f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 0x55b958b41fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b958a9b090 con 0x55b958b3fbb0 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b958a42a70 con 0x55b958b352f0 2024-09-19T08:45:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b958a97050 con 0x55b958b349d0 2024-09-19T08:45:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 0x55b958b41fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 0x55b958b41fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44898/0 (socket says 172.21.15.18:44898) 2024-09-19T08:45:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/2803859587 learned_addr learned my addr 172.21.15.18:0/2803859587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5edb7fe640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5ed00a3240 0x7f5ed00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b349d0 0x55b958b34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b352f0 0x55b958b3f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/2803859587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b349d0 msgr2=0x55b958b34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b349d0 0x55b958b34db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/2803859587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b352f0 msgr2=0x55b958b3f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b352f0 0x55b958b3f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/2803859587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b958a4f130 con 0x55b958b3fbb0 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b352f0 0x55b958b3f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5edb7fe640 1 -- 172.21.15.18:0/773247611 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5ee00d1270 con 0x7f5ee4100a80 2024-09-19T08:45:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b349d0 0x55b958b34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5ed00a3240 0x7f5ed00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.650+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 0x55b958b41fa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006010 tx=0x7f5ed4032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fde3f5eb0adb9de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5ed8ff9640 1 -- 172.21.15.18:0/2803859587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed403f070 con 0x55b958b3fbb0 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5ed8ff9640 1 -- 172.21.15.18:0/2803859587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ed40316a0 con 0x55b958b3fbb0 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5ed8ff9640 1 -- 172.21.15.18:0/2803859587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4035070 con 0x55b958b3fbb0 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2803859587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 msgr2=0x55b958b41fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 0x55b958b41fa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006010 tx=0x7f5ed4032c30 comp rx=0 tx=0).stop 2024-09-19T08:45:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5ed00a3240 0x7f5ed00a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009270 tx=0x7f5edc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2803859587 shutdown_connections 2024-09-19T08:45:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.651+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b3fbb0 0x55b958b41fa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b352f0 0x55b958b3f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2803859587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b349d0 0x55b958b34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2803859587 >> 172.21.15.18:0/2803859587 conn(0x55b958b30f60 msgr2=0x55b958b31340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2803859587 shutdown_connections 2024-09-19T08:45:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2803859587 wait complete. 2024-09-19T08:45:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- start start 2024-09-19T08:45:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 Processor -- start 2024-09-19T08:45:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 0x55b958b3f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b352f0 0x55b958b3c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b3fbb0 0x55b958b3cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b958b42780 con 0x55b958b349d0 2024-09-19T08:45:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b958a55f20 con 0x55b958b3fbb0 2024-09-19T08:45:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b958b42900 con 0x55b958b352f0 2024-09-19T08:45:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eee9e5740 10 client.0 _ll_register_callbacks cb 0x55b958a1f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.652+0000 7f5eea3a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 0x55b958b3f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eeaba9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b3fbb0 0x55b958b3cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 0x55b958b3f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44902/0 (socket says 172.21.15.18:44902) 2024-09-19T08:45:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 -- 172.21.15.18:0/2246897730 learned_addr learned my addr 172.21.15.18:0/2246897730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b352f0 0x55b958b3c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 -- 172.21.15.18:0/2246897730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b352f0 msgr2=0x55b958b3c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b352f0 0x55b958b3c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 -- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b3fbb0 msgr2=0x55b958b3cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b3fbb0 0x55b958b3cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 -- 172.21.15.18:0/2246897730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b95880c2b0 con 0x55b958b349d0 2024-09-19T08:45:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b352f0 0x55b958b3c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 0x55b958b3f380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00ce940 tx=0x7f5ee0013a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2ad1aab7ae3db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ecdffb640 1 -- 172.21.15.18:0/2246897730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee009d460 con 0x55b958b349d0 2024-09-19T08:45:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ecdffb640 1 -- 172.21.15.18:0/2246897730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5ee0004950 con 0x55b958b349d0 2024-09-19T08:45:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ed40316a0 con 0x55b958b349d0 2024-09-19T08:45:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ecdffb640 1 -- 172.21.15.18:0/2246897730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5ee00a1810 con 0x55b958b349d0 2024-09-19T08:45:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eee9e5740 10 client.15150 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b958b4df70 con 0x55b958b349d0 2024-09-19T08:45:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.653+0000 7f5ecdffb640 1 -- 172.21.15.18:0/2246897730 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ed40316a0 con 0x55b958b349d0 2024-09-19T08:45:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5ecdffb640 1 -- 172.21.15.18:0/2246897730 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5ee00051c0 con 0x55b958b349d0 2024-09-19T08:45:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5eee9e5740 10 client.15150 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5eee9e5740 10 client.15150 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:45:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5eee9e5740 20 client.15150 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958b50590 0x55b958b51a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5eee9e5740 4 client.15150 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b958aa8600 con 0x55b958b50590 2024-09-19T08:45:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958b50590 0x55b958b51a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958b50590 0x55b958b51a00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b549e793b8e073ee server_cookie=c8fc6382bfe3e9df in_seq=0 out_seq=0 2024-09-19T08:45:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.654+0000 7f5ecdffb640 10 client.15150 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.655+0000 7f5ecdffb640 1 -- 172.21.15.18:0/2246897730 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b958aa8600 con 0x55b958b50590 2024-09-19T08:45:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.655+0000 7f5ecdffb640 10 client.15150 handle_command_reply: tid=0 2024-09-19T08:45:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.655+0000 7f5eee9e5740 1 client.15150 shutdown 2024-09-19T08:45:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 msgr2=0x55b958b3f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 0x55b958b3f380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00ce940 tx=0x7f5ee0013a90 comp rx=0 tx=0).stop 2024-09-19T08:45:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 shutdown_connections 2024-09-19T08:45:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958b50590 0x55b958b51a00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b3fbb0 0x55b958b3cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "ed3de594-7661-11ef-bceb-c7b262605968", 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24497, 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 126.16678668500001, 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 21, 2024-09-19T08:45:20.706 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 90, 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 136.41943144499999 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b352f0 0x55b958b3c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5ecdffb640 0 client.15150 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/2246897730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b349d0 0x55b958b3f380 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 >> 172.21.15.18:0/2246897730 conn(0x55b958b30f60 msgr2=0x55b958b36c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 shutdown_connections 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 1 -- 172.21.15.18:0/2246897730 wait complete. 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.656+0000 7f5eee9e5740 20 client.15150 trim_cache size 0 max 16384 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.673+0000 7f5eee9e5740 1 Processor -- start 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.673+0000 7f5eee9e5740 1 -- start start 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b50c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b3bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b3afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b958b4fd40 con 0x55b958b352f0 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b958b50410 con 0x55b958b349d0 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b958b50ae0 con 0x55b958b3fbb0 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b3bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b3bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44914/0 (socket says 172.21.15.18:44914) 2024-09-19T08:45:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/350406363 learned_addr learned my addr 172.21.15.18:0/350406363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b3afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b50c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/350406363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 msgr2=0x55b958b3afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b3afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/350406363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 msgr2=0x55b958b50c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b50c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/350406363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b958b30d90 con 0x55b958b352f0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b3bf90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40096c0 tx=0x7f5ed4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e822cc70e8c801f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ecffff640 1 -- 172.21.15.18:0/350406363 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4035050 con 0x55b958b352f0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ecffff640 1 -- 172.21.15.18:0/350406363 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ed4005040 con 0x55b958b352f0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.674+0000 7f5ecffff640 1 -- 172.21.15.18:0/350406363 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed403f040 con 0x55b958b352f0 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 -- 172.21.15.18:0/350406363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 msgr2=0x55b958b3bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b3bf90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40096c0 tx=0x7f5ed4031400 comp rx=0 tx=0).stop 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 -- 172.21.15.18:0/350406363 shutdown_connections 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b3afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b3bf90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/350406363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b50c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 -- 172.21.15.18:0/350406363 >> 172.21.15.18:0/350406363 conn(0x55b958b30f60 msgr2=0x55b958b31340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 -- 172.21.15.18:0/350406363 shutdown_connections 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 -- 172.21.15.18:0/350406363 wait complete. 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 -- start start 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.675+0000 7f5eee9e5740 1 Processor -- start 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b5a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b36c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b37280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b958b51880 con 0x55b958b352f0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b958b511b0 con 0x55b958b349d0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b958b51f50 con 0x55b958b3fbb0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 10 client.0 _ll_register_callbacks cb 0x7f5ee009d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b36c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b36c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44920/0 (socket says 172.21.15.18:44920) 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/505367897 learned_addr learned my addr 172.21.15.18:0/505367897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b5a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eeaba9640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b37280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/505367897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 msgr2=0x55b958b37280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b37280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 msgr2=0x55b958b5a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b5a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 -- 172.21.15.18:0/505367897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b958b37a80 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ee9ba7640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b36c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4005940 tx=0x7f5ed4032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450039070f405e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ecdffb640 1 -- 172.21.15.18:0/505367897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed403f070 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5ecdffb640 1 -- 172.21.15.18:0/505367897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5ed4031a70 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.676+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ed4005040 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5ecdffb640 1 -- 172.21.15.18:0/505367897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5ed405b050 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 10 client.15156 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b958bbedc0 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5ecdffb640 1 -- 172.21.15.18:0/505367897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ed4005040 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5ecdffb640 1 -- 172.21.15.18:0/505367897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5ed4004aa0 con 0x55b958b352f0 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 10 client.15156 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 10 client.15156 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:45:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 20 client.15156 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958bc3190 0x55b958bc1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 4 client.15156 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "status"}) -- 0x55b958aa2b10 con 0x55b958bc3190 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.677+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958bc3190 0x55b958bc1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eea3a8640 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958bc3190 0x55b958bc1ea0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7988df892bf5bf28 server_cookie=fe899ab8fdf73bb4 in_seq=0 out_seq=0 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5ecdffb640 10 client.15156 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5ecdffb640 1 -- 172.21.15.18:0/505367897 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b958aa2b10 con 0x55b958bc3190 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5ecdffb640 10 client.15156 handle_command_reply: tid=0 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 client.15156 shutdown 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 msgr2=0x55b958b36c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b36c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4005940 tx=0x7f5ed4032c30 comp rx=0 tx=0).stop 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 shutdown_connections 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55b958bc3190 0x55b958bc1ea0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b958b3fbb0 0x55b958b37280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b958b352f0 0x55b958b36c50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 --2- 172.21.15.18:0/505367897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b958b349d0 0x55b958b5a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 >> 172.21.15.18:0/505367897 conn(0x55b958b30f60 msgr2=0x55b958b3bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5ecdffb640 0 client.15156 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 shutdown_connections 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 1 -- 172.21.15.18:0/505367897 wait complete. 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.678+0000 7f5eee9e5740 20 client.15156 trim_cache size 0 max 16384 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5ed00a3240 msgr2=0x7f5ed00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5ed00a3240 0x7f5ed00a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009270 tx=0x7f5edc004a40 comp rx=0 tx=0).stop 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 msgr2=0x7f5ee41972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee41972b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009860 tx=0x7f5ee0009d20 comp rx=0 tx=0).stop 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 shutdown_connections 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f5ed00a3240 0x7f5ed00a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee4106a80 0x7f5ee419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ee4101420 0x7f5ee41977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 --2- 172.21.15.18:0/773247611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee4100a80 0x7f5ee41972b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 >> 172.21.15.18:0/773247611 conn(0x7f5ee40fc7a0 msgr2=0x7f5ee40fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 shutdown_connections 2024-09-19T08:45:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:20.679+0000 7f5eec60c640 1 -- 172.21.15.18:0/773247611 wait complete. 2024-09-19T08:45:20.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:20 smithi150 ceph-mon[34610]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:45:20.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:20 smithi162 ceph-mon[34870]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:45:20.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:20 smithi018 ceph-mon[30956]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:45:21.415 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T08:45:21.425 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T08:45:21.425 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T08:45:21.426 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T08:45:21.426 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T08:45:21.437 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T08:45:21.437 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T08:45:21.437 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T08:45:21.437 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:45:21.437 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:21.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:21.438 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T08:45:21.456 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T08:45:21.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:21.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:45:21.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:21.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T08:45:21.644 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T08:45:21.644 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T08:45:21.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T08:45:21.905 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:21.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:21 smithi162 ceph-mon[34870]: pgmap v351: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T08:45:21.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:21 smithi018 ceph-mon[30956]: pgmap v351: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T08:45:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:21 smithi150 ceph-mon[34610]: pgmap v351: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 -- 172.21.15.18:0/656687207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 msgr2=0x7f97f0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 --2- 172.21.15.18:0/656687207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f0106e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009930 tx=0x7f97ec02a420 comp rx=0 tx=0).stop 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 -- 172.21.15.18:0/656687207 shutdown_connections 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 --2- 172.21.15.18:0/656687207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97f0101420 0x7f97f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 --2- 172.21.15.18:0/656687207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97f0100a80 0x7f97f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 --2- 172.21.15.18:0/656687207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f0106e60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 -- 172.21.15.18:0/656687207 >> 172.21.15.18:0/656687207 conn(0x7f97f00fc7a0 msgr2=0x7f97f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 -- 172.21.15.18:0/656687207 shutdown_connections 2024-09-19T08:45:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.425+0000 7f97f796d640 1 -- 172.21.15.18:0/656687207 wait complete. 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 Processor -- start 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 -- start start 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97f0100a80 0x7f97f019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97f0101420 0x7f97f019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0110d50 con 0x7f97f0106a80 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0110bd0 con 0x7f97f0101420 2024-09-19T08:45:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f796d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0110ed0 con 0x7f97f0100a80 2024-09-19T08:45:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f5f0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.426+0000 7f97f5f0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44930/0 (socket says 172.21.15.18:44930) 2024-09-19T08:45:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 -- 172.21.15.18:0/2395262106 learned_addr learned my addr 172.21.15.18:0/2395262106 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5709640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97f0100a80 0x7f97f019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f4f08640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97f0101420 0x7f97f019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 -- 172.21.15.18:0/2395262106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97f0100a80 msgr2=0x7f97f019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97f0100a80 0x7f97f019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 -- 172.21.15.18:0/2395262106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97f0101420 msgr2=0x7f97f019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97f0101420 0x7f97f019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 -- 172.21.15.18:0/2395262106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f019f590 con 0x7f97f0106a80 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f5f0a640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f019eeb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f97e800b970 tx=0x7f97e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8019070 con 0x7f97f0106a80 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97e8014440 con 0x7f97f0106a80 2024-09-19T08:45:22.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f019f880 con 0x7f97f0106a80 2024-09-19T08:45:22.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80075d0 con 0x7f97f0106a80 2024-09-19T08:45:22.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.427+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f01a7160 con 0x7f97f0106a80 2024-09-19T08:45:22.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.428+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f0100ee0 con 0x7f97f0106a80 2024-09-19T08:45:22.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.430+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f97e801c070 con 0x7f97f0106a80 2024-09-19T08:45:22.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.431+0000 7f97e67fc640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f97dc0a3240 0x7f97dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.431+0000 7f97f5709640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f97dc0a3240 0x7f97dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.431+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f97e80cf230 con 0x7f97f0106a80 2024-09-19T08:45:22.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.431+0000 7f97f5709640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f97dc0a3240 0x7f97dc0a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97ec006010 tx=0x7f97ec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.435+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97e809b530 con 0x7f97f0106a80 2024-09-19T08:45:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.654+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f97f01a7400 con 0x7f97f0106a80 2024-09-19T08:45:22.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.654+0000 7f97e67fc640 1 -- 172.21.15.18:0/2395262106 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7f97e809f830 con 0x7f97f0106a80 2024-09-19T08:45:22.655 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:45:22.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.656+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f97dc0a3240 msgr2=0x7f97dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.656+0000 7f97f796d640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f97dc0a3240 0x7f97dc0a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97ec006010 tx=0x7f97ec000bc0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.656+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 msgr2=0x7f97f019eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.656+0000 7f97f796d640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f019eeb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f97e800b970 tx=0x7f97e800be30 comp rx=0 tx=0).stop 2024-09-19T08:45:22.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 shutdown_connections 2024-09-19T08:45:22.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f97dc0a3240 0x7f97dc0a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97f0106a80 0x7f97f019eeb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97f0101420 0x7f97f019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 --2- 172.21.15.18:0/2395262106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97f0100a80 0x7f97f019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 >> 172.21.15.18:0/2395262106 conn(0x7f97f00fc7a0 msgr2=0x7f97f006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 shutdown_connections 2024-09-19T08:45:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:22.657+0000 7f97f796d640 1 -- 172.21.15.18:0/2395262106 wait complete. 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:45:23.331 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:45:23.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:23.332 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T08:45:23.351 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:45:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:45:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:45:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T08:45:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T08:45:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42105sec preferred_lft 42105sec 2024-09-19T08:45:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T08:45:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:45:23.353 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:45:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:45:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T08:45:23.353 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:45:23.353 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:45:23.354 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:45:23.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:45:23.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-19T08:45:23.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-19T08:45:23.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:45:23.354 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:45:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:45:23.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:45:23.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:23.499 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:45:23.527 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T08:45:23.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:23.534 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T08:45:23.592 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T08:45:23.592 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:45:23.592 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T08:45:23.593 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T08:45:23.593 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:45:23.593 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:45:23.593 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:45:23.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T08:45:23.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T08:45:23.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T08:45:23.593 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:45:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:45:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:45:23.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:23.724 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T08:45:23.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:23.741 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-19T08:45:23.797 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:45:23.797 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:45:23.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:45:23.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T08:45:23.797 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:45:23.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:23 smithi018 ceph-mon[30956]: pgmap v352: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:45:23.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:23 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2395262106' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:45:23.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:45:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:45:23.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:23 smithi162 ceph-mon[34870]: pgmap v352: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:45:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:23 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/2395262106' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:45:23.920 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T08:45:23.920 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:45:23.920 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:45:23.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T08:45:23.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:45:23.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T08:45:23.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T08:45:23.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T08:45:23.921 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:45:23.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:45:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:45:24.042 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:45:24.042 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T08:45:24.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T08:45:24.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:45:24.042 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T08:45:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:23 smithi150 ceph-mon[34610]: pgmap v352: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:45:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:23 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/2395262106' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:45:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:45:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:45:24.123 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T08:45:24.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:45:24.124 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:24.139 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:45:24.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:45:24.139 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:24.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-19T08:45:24.262 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-19T08:45:24.319 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-19T08:45:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/72dba623d3ade913a0fa1de30183490f8fe57b5240b0ced302064de5909316a8/merged 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/1ff47cfa4b9e875eecbe62abb5d473770baddd402796eafdc12106047286a555/merged 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/730222ea4c5f1f1953afdd2a6b4d54a5aef04625e8938a816fceeb748fc3d9ff/merged 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/64b641414ff56b22c75132942f7b40fbf82cdc3cd6458fb1b2cc5d5a28ece127/merged 2024-09-19T08:45:24.321 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/da10f006617bc1e98f41fce0ed35af2090dfbb7b49d3a2b6f5dafa72fc0379d4/merged 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9fba0f733ef426ec2f4ead4c349f0d402fcd35994e020839941126d78a802dcb/merged 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8002d265c55365bb259ea1cec7ee717929c7f8a1f4212cafe9dc397636b617d/merged 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/2d2a365bcd144639c8d26af9130356c09075e046f3d77d65a4ca01b420fee2ca/merged 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/62f06939a10d24fc20de4496d7811beb90a3ebf99b55d6513164ea5fe2bf9a94/merged 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/880bae033491acabca257ada6b19a22ba6a6bada30bdaf414b35fc2b6a4a0056/merged 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:45:24.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:24.322 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-19T08:45:24.375 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:45:24.375 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/adf712cf-7290-4ac0-98c8-dd17610ec168 --client_fs=cephfs) 2024-09-19T08:45:24.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-19T08:45:24.443 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-19T08:45:24.501 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:45:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/72dba623d3ade913a0fa1de30183490f8fe57b5240b0ced302064de5909316a8/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/1ff47cfa4b9e875eecbe62abb5d473770baddd402796eafdc12106047286a555/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/730222ea4c5f1f1953afdd2a6b4d54a5aef04625e8938a816fceeb748fc3d9ff/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/64b641414ff56b22c75132942f7b40fbf82cdc3cd6458fb1b2cc5d5a28ece127/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/da10f006617bc1e98f41fce0ed35af2090dfbb7b49d3a2b6f5dafa72fc0379d4/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9fba0f733ef426ec2f4ead4c349f0d402fcd35994e020839941126d78a802dcb/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8002d265c55365bb259ea1cec7ee717929c7f8a1f4212cafe9dc397636b617d/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/2d2a365bcd144639c8d26af9130356c09075e046f3d77d65a4ca01b420fee2ca/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/62f06939a10d24fc20de4496d7811beb90a3ebf99b55d6513164ea5fe2bf9a94/merged 2024-09-19T08:45:24.503 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/880bae033491acabca257ada6b19a22ba6a6bada30bdaf414b35fc2b6a4a0056/merged 2024-09-19T08:45:24.504 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-19T08:45:24.504 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:45:24.504 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:45:24.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:24.504 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-19T08:45:24.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:2024-09-19T08:45:24.502+0000 7f79f8924480 -1 init, newargv = 0x55dab7997c90 newargc=15 2024-09-19T08:45:24.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[83604]: starting ceph client 2024-09-19T08:45:24.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[83604]: starting fuse 2024-09-19T08:45:24.521 INFO:teuthology.orchestra.run.smithi018.stdout:96 2024-09-19T08:45:24.521 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [96] 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-09-19T08:45:24.522 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.0")) 2024-09-19T08:45:24.523 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T08:45:24.647 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.0.83604.asok 2024-09-19T08:45:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:45:24.654 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.83604.asok 2024-09-19T08:45:24.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:24.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.83604.asok status 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "0", 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-09-19T08:45:24.792 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "83604", 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/volumes/qa/sv_0/adf712cf-7290-4ac0-98c8-dd17610ec168" 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 15168, 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 15168 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:45:24.793 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3863436933 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3863436933 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.15168 192.168.0.1:0/3863436933", 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/3863436933", 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 5, 2024-09-19T08:45:24.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 21, 2024-09-19T08:45:24.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 90, 2024-09-19T08:45:24.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:45:24.795 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-09-19T08:45:24.795 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-09-19T08:45:24.795 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:45:24.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:24.801 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-09-19T08:45:24.801 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:24.817 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-09-19T08:45:24.817 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:24.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:45:24.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:24.885 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T08:45:24.896 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T08:45:24.906 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:45:24.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T08:45:24.927 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T08:45:24.993 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:45:24.993 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T08:45:24.993 INFO:tasks.workunit:timeout=3h 2024-09-19T08:45:24.993 INFO:tasks.workunit:cleanup=True 2024-09-19T08:45:24.994 DEBUG:teuthology.orchestra.run.smithi018:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:25.010 INFO:teuthology.orchestra.run.smithi018.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:25.010 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T08:45:25.010 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 60h/96d Inode: 1 Links: 2 2024-09-19T08:45:25.010 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:45:25.010 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T08:45:25.010 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 08:44:00.140961259 +0000 2024-09-19T08:45:25.011 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 08:44:00.140961259 +0000 2024-09-19T08:45:25.011 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 08:45:24.883245930 +0000 2024-09-19T08:45:25.011 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-19T08:45:25.011 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T08:45:25.011 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T08:45:25.081 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:45:25.138 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T08:45:25.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:25 smithi162 ceph-mon[34870]: pgmap v353: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:45:25.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:25 smithi018 ceph-mon[30956]: pgmap v353: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:45:26.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:25 smithi150 ceph-mon[34610]: pgmap v353: 129 pgs: 2 activating, 127 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T08:45:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:27 smithi162 ceph-mon[34870]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-19T08:45:27.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:27 smithi018 ceph-mon[30956]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-19T08:45:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:27 smithi150 ceph-mon[34610]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-19T08:45:29.867 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:29 smithi150 ceph-mon[34610]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-19T08:45:29.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:29 smithi162 ceph-mon[34870]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-19T08:45:29.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:29 smithi018 ceph-mon[30956]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-19T08:45:31.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:31 smithi162 ceph-mon[34870]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T08:45:31.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:31 smithi018 ceph-mon[30956]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T08:45:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:31 smithi150 ceph-mon[34610]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T08:45:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:33 smithi162 ceph-mon[34870]: pgmap v357: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T08:45:33.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:33 smithi018 ceph-mon[30956]: pgmap v357: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T08:45:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:33 smithi150 ceph-mon[34610]: pgmap v357: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T08:45:35.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:35 smithi162 ceph-mon[34870]: pgmap v358: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T08:45:35.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:35 smithi018 ceph-mon[30956]: pgmap v358: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T08:45:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:35 smithi150 ceph-mon[34610]: pgmap v358: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T08:45:37.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:37 smithi162 ceph-mon[34870]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T08:45:37.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:37 smithi018 ceph-mon[30956]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T08:45:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:37 smithi150 ceph-mon[34610]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T08:45:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 -- 172.21.15.18:0/2569363744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0100a40 msgr2=0x7f87c0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 --2- 172.21.15.18:0/2569363744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0100a40 0x7f87c0100e40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009ca0 tx=0x7f87b002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 -- 172.21.15.18:0/2569363744 shutdown_connections 2024-09-19T08:45:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 --2- 172.21.15.18:0/2569363744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 0x7f87c0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 --2- 172.21.15.18:0/2569363744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0101c30 0x7f87c01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 --2- 172.21.15.18:0/2569363744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0100a40 0x7f87c0100e40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 -- 172.21.15.18:0/2569363744 >> 172.21.15.18:0/2569363744 conn(0x7f87c00fc1e0 msgr2=0x7f87c00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 -- 172.21.15.18:0/2569363744 shutdown_connections 2024-09-19T08:45:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 -- 172.21.15.18:0/2569363744 wait complete. 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 Processor -- start 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.071+0000 7f87c76e4640 1 -- start start 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c76e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100a40 0x7f87c006a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c76e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 0x7f87c019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c76e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 0x7f87c01a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c76e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010c550 con 0x7f87c0101c30 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c76e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010c3d0 con 0x7f87c01025f0 2024-09-19T08:45:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c76e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010c6d0 con 0x7f87c0100a40 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 0x7f87c019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 0x7f87c019ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50028/0 (socket says 172.21.15.18:50028) 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 -- 172.21.15.18:0/92089180 learned_addr learned my addr 172.21.15.18:0/92089180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c5c81640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 0x7f87c01a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c5480640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100a40 0x7f87c006a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 -- 172.21.15.18:0/92089180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100a40 msgr2=0x7f87c006a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100a40 0x7f87c006a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 -- 172.21.15.18:0/92089180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 msgr2=0x7f87c01a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 0x7f87c01a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 -- 172.21.15.18:0/92089180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c01a1b90 con 0x7f87c0101c30 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c5c81640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 0x7f87c01a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.072+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 0x7f87c019ee50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87b400d950 tx=0x7f87b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.073+0000 7f87be7fc640 1 -- 172.21.15.18:0/92089180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4017030 con 0x7f87c0101c30 2024-09-19T08:45:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.073+0000 7f87be7fc640 1 -- 172.21.15.18:0/92089180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87b4004020 con 0x7f87c0101c30 2024-09-19T08:45:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.073+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c01a1e20 con 0x7f87c0101c30 2024-09-19T08:45:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.073+0000 7f87be7fc640 1 -- 172.21.15.18:0/92089180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40047a0 con 0x7f87c0101c30 2024-09-19T08:45:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.073+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c01a2330 con 0x7f87c0101c30 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.075+0000 7f87be7fc640 1 -- 172.21.15.18:0/92089180 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f87b40041d0 con 0x7f87c0101c30 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 Processor -- start 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 -- start start 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffbdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffc5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559c0ff212f0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559c0fec9270 con 0x559c0ffc3370 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87ca484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559c0ff1d2b0 con 0x559c0ffbe2e0 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffbdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffbdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50030/0 (socket says 172.21.15.18:50030) 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 -- 172.21.15.18:0/1774455484 learned_addr learned my addr 172.21.15.18:0/1774455484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87be7fc640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87a80a33a0 0x7f87a80a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffc5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5480640 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87a80a33a0 0x7f87a80a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 -- 172.21.15.18:0/1774455484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 msgr2=0x559c0ffc2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 -- 172.21.15.18:0/1774455484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 msgr2=0x559c0ffc5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffc5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87c5c81640 1 -- 172.21.15.18:0/1774455484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0fec8340 con 0x559c0ffbd9a0 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.076+0000 7f87be7fc640 1 -- 172.21.15.18:0/92089180 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f87b40cf870 con 0x7f87c0101c30 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.077+0000 7f87c5c81640 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffbdda0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f87b8013790 tx=0x7f87b8013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240a29849e2f7611 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.077+0000 7f87c5c81640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87a80a33a0 0x7f87a80a5860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f87b801b000 tx=0x7f87b801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.077+0000 7f87a77fe640 1 -- 172.21.15.18:0/1774455484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b801c920 con 0x559c0ffbd9a0 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.077+0000 7f87a77fe640 1 -- 172.21.15.18:0/1774455484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87b801d3f0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.077+0000 7f87a77fe640 1 -- 172.21.15.18:0/1774455484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b800e550 con 0x559c0ffbd9a0 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 -- 172.21.15.18:0/1774455484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 msgr2=0x559c0ffbdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffbdda0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f87b8013790 tx=0x7f87b8013c50 comp rx=0 tx=0).stop 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 -- 172.21.15.18:0/1774455484 shutdown_connections 2024-09-19T08:45:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffc5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 --2- 172.21.15.18:0/1774455484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffbdda0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 -- 172.21.15.18:0/1774455484 >> 172.21.15.18:0/1774455484 conn(0x559c0ffb9010 msgr2=0x559c0ffb9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 -- 172.21.15.18:0/1774455484 shutdown_connections 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 -- 172.21.15.18:0/1774455484 wait complete. 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 -- start start 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.078+0000 7f87ca484740 1 Processor -- start 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffcf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559c0ffc6280 con 0x559c0ffbd9a0 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559c0feaa290 con 0x559c0ffbe2e0 2024-09-19T08:45:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559c0ffc6400 con 0x559c0ffc3370 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87ca484740 10 client.0 _ll_register_callbacks cb 0x559c0fedb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50032/0 (socket says 172.21.15.18:50032) 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 -- 172.21.15.18:0/3788212845 learned_addr learned my addr 172.21.15.18:0/3788212845 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5c81640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffcf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 -- 172.21.15.18:0/3788212845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 msgr2=0x559c0ffcf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffcf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 -- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 msgr2=0x559c0ffc8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.079+0000 7f87c5480640 1 -- 172.21.15.18:0/3788212845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c0fc34210 con 0x559c0ffbd9a0 2024-09-19T08:45:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87c5480640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc7bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87c0101a90 tx=0x7f87b0031d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3404f26091762a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3788212845 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0031e60 con 0x559c0ffbd9a0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3788212845 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f87b0003b80 con 0x559c0ffbd9a0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87b801d3f0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3788212845 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f87b0003d80 con 0x559c0ffbd9a0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87ca484740 10 client.15180 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559c0fd00620 con 0x559c0ffbd9a0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.080+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3788212845 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87b801d3f0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3788212845 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f87b00305c0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87ca484740 10 client.15180 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87ca484740 10 client.15180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87ca484740 20 client.15180 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87ca484740 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c0ffd38d0 0x559c0ffd5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87ca484740 4 client.15180 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c0ff2ea20 con 0x559c0ffd38d0 2024-09-19T08:45:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c0ffd38d0 0x559c0ffd5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87a4ff9640 10 client.15180 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.081+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c0ffd38d0 0x559c0ffd5d50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0c95aaa03a24e8 server_cookie=d5abc62b2a12f6bd in_seq=0 out_seq=0 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.082+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3788212845 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c0ff2ea20 con 0x559c0ffd38d0 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.082+0000 7f87a4ff9640 10 client.15180 handle_command_reply: tid=0 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.082+0000 7f87ca484740 1 client.15180 shutdown 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.082+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 msgr2=0x559c0ffc7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.082+0000 7f87ca484740 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc7bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87c0101a90 tx=0x7f87b0031d70 comp rx=0 tx=0).stop 2024-09-19T08:45:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 shutdown_connections 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c0ffd38d0 0x559c0ffd5d50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffcf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffc8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87a4ff9640 0 client.15180 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 --2- 172.21.15.18:0/3788212845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc7bf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 >> 172.21.15.18:0/3788212845 conn(0x559c0ffb9010 msgr2=0x559c0ffba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 shutdown_connections 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 1 -- 172.21.15.18:0/3788212845 wait complete. 2024-09-19T08:45:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.083+0000 7f87ca484740 20 client.15180 trim_cache size 0 max 16384 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 Processor -- start 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 -- start start 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffb80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01aa8f0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01ad170 con 0x559c0ffbe2e0 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87ca484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01aaf60 con 0x559c0ffc3370 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50044/0 (socket says 172.21.15.18:50044) 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 -- 172.21.15.18:0/3674589250 learned_addr learned my addr 172.21.15.18:0/3674589250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5c81640 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffb80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 -- 172.21.15.18:0/3674589250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 msgr2=0x559c0ffb80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffb80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 -- 172.21.15.18:0/3674589250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 msgr2=0x559c0ffcf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 -- 172.21.15.18:0/3674589250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0ffc2860 con 0x559c0ffbd9a0 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87c5480640 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc81c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87b0000f80 tx=0x7f87b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf14150dc2c2470 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.098+0000 7f87a6ffd640 1 -- 172.21.15.18:0/3674589250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0059070 con 0x559c0ffbd9a0 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87a6ffd640 1 -- 172.21.15.18:0/3674589250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87b0036040 con 0x559c0ffbd9a0 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87a6ffd640 1 -- 172.21.15.18:0/3674589250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0003f20 con 0x559c0ffbd9a0 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 -- 172.21.15.18:0/3674589250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 msgr2=0x559c0ffc81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc81c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87b0000f80 tx=0x7f87b0009840 comp rx=0 tx=0).stop 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 -- 172.21.15.18:0/3674589250 shutdown_connections 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffc3370 0x559c0ffb80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 --2- 172.21.15.18:0/3674589250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffc81c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 -- 172.21.15.18:0/3674589250 >> 172.21.15.18:0/3674589250 conn(0x559c0ffb9010 msgr2=0x559c0ffb79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 -- 172.21.15.18:0/3674589250 shutdown_connections 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 -- 172.21.15.18:0/3674589250 wait complete. 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 -- start start 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.099+0000 7f87ca484740 1 Processor -- start 2024-09-19T08:45:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffcc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffcde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01ab630 con 0x559c0ffbd9a0 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01acaa0 con 0x559c0ffc3370 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01abd00 con 0x559c0ffbe2e0 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87ca484740 10 client.0 _ll_register_callbacks cb 0x7f87b0009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffcc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffcc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50046/0 (socket says 172.21.15.18:50046) 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 -- 172.21.15.18:0/3108678042 learned_addr learned my addr 172.21.15.18:0/3108678042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5c81640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffcde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 -- 172.21.15.18:0/3108678042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 msgr2=0x559c0ffcce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 -- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 msgr2=0x559c0ffcde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffcde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5480640 1 -- 172.21.15.18:0/3108678042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c0ffce410 con 0x559c0ffbd9a0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.100+0000 7f87c5c81640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffcde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87c5480640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffcc900 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87b0006010 tx=0x7f87b00307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a5c7a9651a35e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3108678042 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0059040 con 0x559c0ffbd9a0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3108678042 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f87b0003f20 con 0x559c0ffbd9a0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87b0036040 con 0x559c0ffbd9a0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3108678042 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f87b0004160 con 0x559c0ffbd9a0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 10 client.15186 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559c1003e6f0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3108678042 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87b0036040 con 0x559c0ffbd9a0 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3108678042 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f87b002fbe0 con 0x559c0ffbd9a0 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 10 client.15186 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 10 client.15186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 20 client.15186 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c1003efe0 0x559c10041400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 4 client.15186 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.101+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c0ff28d70 con 0x559c1003efe0 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.102+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c1003efe0 0x559c10041400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.102+0000 7f87c4c7f640 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c1003efe0 0x559c10041400 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158f411409b6638c server_cookie=85e285dc1dfc9a78 in_seq=0 out_seq=0 2024-09-19T08:45:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.102+0000 7f87a4ff9640 10 client.15186 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87a4ff9640 1 -- 172.21.15.18:0/3108678042 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c0ff28d70 con 0x559c1003efe0 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87a4ff9640 10 client.15186 handle_command_reply: tid=0 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 client.15186 shutdown 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 msgr2=0x559c0ffcc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffcc900 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87b0006010 tx=0x7f87b00307f0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 shutdown_connections 2024-09-19T08:45:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559c1003efe0 0x559c10041400 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c0ffc3370 0x559c0ffcde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c0ffbe2e0 0x559c0ffcce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 --2- 172.21.15.18:0/3108678042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c0ffbd9a0 0x559c0ffcc900 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87a4ff9640 0 client.15186 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 >> 172.21.15.18:0/3108678042 conn(0x559c0ffb9010 msgr2=0x559c0ffba740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 shutdown_connections 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.115+0000 7f87ca484740 1 -- 172.21.15.18:0/3108678042 wait complete. 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87ca484740 20 client.15186 trim_cache size 0 max 16384 2024-09-19T08:45:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:45:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:45:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:45:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:45:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87a80a33a0 msgr2=0x7f87a80a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87a80a33a0 0x7f87a80a5860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f87b801b000 tx=0x7f87b801d000 comp rx=0 tx=0).stop 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 msgr2=0x7f87c019ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 0x7f87c019ee50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87b400d950 tx=0x7f87b400de10 comp rx=0 tx=0).stop 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 shutdown_connections 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f87a80a33a0 0x7f87a80a5860 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87c01025f0 0x7f87c01a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c0101c30 0x7f87c019ee50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 --2- 172.21.15.18:0/92089180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100a40 0x7f87c006a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 >> 172.21.15.18:0/92089180 conn(0x7f87c00fc1e0 msgr2=0x7f87c0105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 shutdown_connections 2024-09-19T08:45:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:38.116+0000 7f87c76e4640 1 -- 172.21.15.18:0/92089180 wait complete. 2024-09-19T08:45:39.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:39 smithi162 ceph-mon[34870]: pgmap v360: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-19T08:45:39.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:39 smithi018 ceph-mon[30956]: pgmap v360: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-19T08:45:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:39 smithi150 ceph-mon[34610]: pgmap v360: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-19T08:45:41.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:41 smithi162 ceph-mon[34870]: pgmap v361: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T08:45:41.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:41 smithi018 ceph-mon[30956]: pgmap v361: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T08:45:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:41 smithi150 ceph-mon[34610]: pgmap v361: 129 pgs: 129 active+clean; 655 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T08:45:43.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:43 smithi162 ceph-mon[34870]: pgmap v362: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-19T08:45:43.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:43 smithi018 ceph-mon[30956]: pgmap v362: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-19T08:45:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:43 smithi150 ceph-mon[34610]: pgmap v362: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-19T08:45:45.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:45 smithi162 ceph-mon[34870]: pgmap v363: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-19T08:45:45.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:45 smithi018 ceph-mon[30956]: pgmap v363: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-19T08:45:46.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:45 smithi150 ceph-mon[34610]: pgmap v363: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-19T08:45:47.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:47 smithi162 ceph-mon[34870]: pgmap v364: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-19T08:45:47.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:47 smithi018 ceph-mon[30956]: pgmap v364: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-19T08:45:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:47 smithi150 ceph-mon[34610]: pgmap v364: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-19T08:45:49.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:49 smithi162 ceph-mon[34870]: pgmap v365: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-09-19T08:45:49.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:49 smithi018 ceph-mon[30956]: pgmap v365: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-09-19T08:45:50.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:49 smithi150 ceph-mon[34610]: pgmap v365: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 -- 172.21.15.18:0/3039698557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 msgr2=0x7f85c41072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3039698557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c41072e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009900 tx=0x7f85b802a410 comp rx=0 tx=0).stop 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 -- 172.21.15.18:0/3039698557 shutdown_connections 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3039698557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c4107820 0x7f85c4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3039698557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c41072e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3039698557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c41049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 -- 172.21.15.18:0/3039698557 >> 172.21.15.18:0/3039698557 conn(0x7f85c40fc1e0 msgr2=0x7f85c40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 -- 172.21.15.18:0/3039698557 shutdown_connections 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.218+0000 7f85caa1e640 1 -- 172.21.15.18:0/3039698557 wait complete. 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 Processor -- start 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 -- start start 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c4199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c4107820 0x7f85c41a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85c410d6a0 con 0x7f85c4104ef0 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85c410d520 con 0x7f85c4107820 2024-09-19T08:45:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85caa1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85c410d820 con 0x7f85c41025c0 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85c37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85c3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c4199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85c3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c4199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42340/0 (socket says 172.21.15.18:42340) 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85c3fff640 1 -- 172.21.15.18:0/3157871937 learned_addr learned my addr 172.21.15.18:0/3157871937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.219+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c4107820 0x7f85c41a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c3fff640 1 -- 172.21.15.18:0/3157871937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c4107820 msgr2=0x7f85c41a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c3fff640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c4107820 0x7f85c41a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c3fff640 1 -- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 msgr2=0x7f85c419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c3fff640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c3fff640 1 -- 172.21.15.18:0/3157871937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c41a1b40 con 0x7f85c41025c0 2024-09-19T08:45:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c37fe640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c3fff640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c4199f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85b400d770 tx=0x7f85b400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c17fa640 1 -- 172.21.15.18:0/3157871937 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4017070 con 0x7f85c41025c0 2024-09-19T08:45:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c41a1e30 con 0x7f85c41025c0 2024-09-19T08:45:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c17fa640 1 -- 172.21.15.18:0/3157871937 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85b40054d0 con 0x7f85c41025c0 2024-09-19T08:45:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85c17fa640 1 -- 172.21.15.18:0/3157871937 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4004cf0 con 0x7f85c41025c0 2024-09-19T08:45:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.220+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c41a2240 con 0x7f85c41025c0 2024-09-19T08:45:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 Processor -- start 2024-09-19T08:45:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 -- start start 2024-09-19T08:45:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c17fa640 1 -- 172.21.15.18:0/3157871937 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f85b4004e90 con 0x7f85c41025c0 2024-09-19T08:45:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a60ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a60fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a612830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a80a56e2f0 con 0x55a80a610370 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a80a516270 con 0x55a80a60a9a0 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85cd88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a80a56a2b0 con 0x55a80a60b2e0 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a612830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a612830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44112/0 (socket says 172.21.15.18:44112) 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 -- 172.21.15.18:0/2538803567 learned_addr learned my addr 172.21.15.18:0/2538803567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a60ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c3fff640 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a60fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 -- 172.21.15.18:0/2538803567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 msgr2=0x55a80a60fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a60fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 -- 172.21.15.18:0/2538803567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 msgr2=0x55a80a60ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a60ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c37fe640 1 -- 172.21.15.18:0/2538803567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80a515340 con 0x55a80a610370 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.223+0000 7f85c3fff640 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a60fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85c17fa640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f85ac0a32f0 0x7f85ac0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85c37fe640 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a612830 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009900 tx=0x7f85b8031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f614797b9c396e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f85ac0a32f0 0x7f85ac0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85c17fa640 1 -- 172.21.15.18:0/3157871937 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f85b40cf750 con 0x7f85c41025c0 2024-09-19T08:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85aa7fc640 1 -- 172.21.15.18:0/2538803567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b8035070 con 0x55a80a610370 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85aa7fc640 1 -- 172.21.15.18:0/2538803567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85b80035f0 con 0x55a80a610370 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.224+0000 7f85aa7fc640 1 -- 172.21.15.18:0/2538803567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b80044e0 con 0x55a80a610370 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 -- 172.21.15.18:0/2538803567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 msgr2=0x55a80a612830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a612830 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009900 tx=0x7f85b8031630 comp rx=0 tx=0).stop 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f85ac0a32f0 0x7f85ac0a57b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85c406a980 tx=0x7f85bc007680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 -- 172.21.15.18:0/2538803567 shutdown_connections 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a612830 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a60fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2538803567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a60ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 -- 172.21.15.18:0/2538803567 >> 172.21.15.18:0/2538803567 conn(0x55a80a606010 msgr2=0x55a80a606410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 -- 172.21.15.18:0/2538803567 shutdown_connections 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 -- 172.21.15.18:0/2538803567 wait complete. 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 -- start start 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 Processor -- start 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.225+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a614b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a6150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85cd88d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a80a6132e0 con 0x55a80a610370 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85cd88d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a80a4f7290 con 0x55a80a60a9a0 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85cd88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a80a613460 con 0x55a80a60b2e0 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85cd88d740 10 client.0 _ll_register_callbacks cb 0x55a80a528140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44118/0 (socket says 172.21.15.18:44118) 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 -- 172.21.15.18:0/4222207687 learned_addr learned my addr 172.21.15.18:0/4222207687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c3fff640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a614b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c37fe640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a6150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 -- 172.21.15.18:0/4222207687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 msgr2=0x55a80a6150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a6150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 -- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 msgr2=0x55a80a614b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a614b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 -- 172.21.15.18:0/4222207687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a80a281210 con 0x55a80a610370 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c37fe640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a6150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c3fff640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a614b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61c0e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00ed80 tx=0x7f85bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dd81830950e7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.226+0000 7f85a37fe640 1 -- 172.21.15.18:0/4222207687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc01ccb0 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85a37fe640 1 -- 172.21.15.18:0/4222207687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f85bc028480 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b80035f0 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85a37fe640 1 -- 172.21.15.18:0/4222207687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f85bc01ce50 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 10 client.15198 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a80a34d620 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85a37fe640 1 -- 172.21.15.18:0/4222207687 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85b80035f0 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85a37fe640 1 -- 172.21.15.18:0/4222207687 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f85bc01d810 con 0x55a80a610370 2024-09-19T08:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 10 client.15198 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 10 client.15198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 20 client.15198 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a620830 0x55a80a622c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 4 client.15198 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a80a57ba20 con 0x55a80a620830 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.227+0000 7f85c3fff640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a620830 0x55a80a622c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.228+0000 7f85a37fe640 10 client.15198 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.228+0000 7f85c3fff640 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a620830 0x55a80a622c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8e268182cba1ff4 server_cookie=56e4277fde2b4aba in_seq=0 out_seq=0 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85a37fe640 1 -- 172.21.15.18:0/4222207687 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a80a57ba20 con 0x55a80a620830 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85a37fe640 10 client.15198 handle_command_reply: tid=0 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 client.15198 shutdown 2024-09-19T08:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 msgr2=0x55a80a61c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61c0e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00ed80 tx=0x7f85bc004a40 comp rx=0 tx=0).stop 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 shutdown_connections 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a620830 0x55a80a622c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61c0e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60b2e0 0x55a80a6150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85a37fe640 0 client.15198 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 --2- 172.21.15.18:0/4222207687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60a9a0 0x55a80a614b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 >> 172.21.15.18:0/4222207687 conn(0x55a80a606010 msgr2=0x55a80a607820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 shutdown_connections 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 1 -- 172.21.15.18:0/4222207687 wait complete. 2024-09-19T08:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.229+0000 7f85cd88d740 20 client.15198 trim_cache size 0 max 16384 2024-09-19T08:45:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.244+0000 7f85cd88d740 1 Processor -- start 2024-09-19T08:45:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 -- start start 2024-09-19T08:45:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a606ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a61c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a607400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85c41aa830 con 0x55a80a610370 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85c41ad0b0 con 0x55a80a60b2e0 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85cd88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85c41aaea0 con 0x55a80a60a9a0 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a607400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a607400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44132/0 (socket says 172.21.15.18:44132) 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 -- 172.21.15.18:0/3479558848 learned_addr learned my addr 172.21.15.18:0/3479558848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c3fff640 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a606ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c37fe640 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a61c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 -- 172.21.15.18:0/3479558848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 msgr2=0x55a80a606ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a606ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 -- 172.21.15.18:0/3479558848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 msgr2=0x55a80a61c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a61c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 -- 172.21.15.18:0/3479558848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80a605e30 con 0x55a80a610370 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c3fff640 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a606ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.245+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a607400 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f85bc011ca0 tx=0x7f85bc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae79e767d0a9dc39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85a9ffb640 1 -- 172.21.15.18:0/3479558848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc03a070 con 0x55a80a610370 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85a9ffb640 1 -- 172.21.15.18:0/3479558848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85bc007b20 con 0x55a80a610370 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85a9ffb640 1 -- 172.21.15.18:0/3479558848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc01ee60 con 0x55a80a610370 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 -- 172.21.15.18:0/3479558848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 msgr2=0x55a80a607400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a607400 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f85bc011ca0 tx=0x7f85bc01c7f0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 -- 172.21.15.18:0/3479558848 shutdown_connections 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a607400 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a61c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 --2- 172.21.15.18:0/3479558848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a606ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 -- 172.21.15.18:0/3479558848 >> 172.21.15.18:0/3479558848 conn(0x55a80a606010 msgr2=0x55a80a614b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 -- 172.21.15.18:0/3479558848 shutdown_connections 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.246+0000 7f85cd88d740 1 -- 172.21.15.18:0/3479558848 wait complete. 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 -- start start 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 Processor -- start 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a619460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a6199a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85c41ab570 con 0x55a80a610370 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85c41ac9e0 con 0x55a80a60b2e0 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85c41abc40 con 0x55a80a60a9a0 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85cd88d740 10 client.0 _ll_register_callbacks cb 0x7f85bc007920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85c8fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85c8fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44134/0 (socket says 172.21.15.18:44134) 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.247+0000 7f85c8fbb640 1 -- 172.21.15.18:0/2470425241 learned_addr learned my addr 172.21.15.18:0/2470425241 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c37fe640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a6199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c3fff640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a619460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c8fbb640 1 -- 172.21.15.18:0/2470425241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 msgr2=0x55a80a619460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a619460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c8fbb640 1 -- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 msgr2=0x55a80a6199a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a6199a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c8fbb640 1 -- 172.21.15.18:0/2470425241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a80a61af50 con 0x55a80a610370 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c3fff640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a619460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85c8fbb640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61a940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01dd00 tx=0x7f85bc011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410ac6ecd0e9cf2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85a37fe640 1 -- 172.21.15.18:0/2470425241 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc03a040 con 0x55a80a610370 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85a37fe640 1 -- 172.21.15.18:0/2470425241 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f85bc005040 con 0x55a80a610370 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85bc007b20 con 0x55a80a610370 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85a37fe640 1 -- 172.21.15.18:0/2470425241 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f85bc005240 con 0x55a80a610370 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85cd88d740 10 client.15204 fetch_fsmap learned FSMap version 21 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.248+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a80a61c260 con 0x55a80a610370 2024-09-19T08:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85a37fe640 1 -- 172.21.15.18:0/2470425241 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85bc007b20 con 0x55a80a610370 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85a37fe640 1 -- 172.21.15.18:0/2470425241 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f85bc0289a0 con 0x55a80a610370 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85cd88d740 10 client.15204 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85cd88d740 10 client.15204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85cd88d740 20 client.15204 populate_metadata read hostname 'smithi018' 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a68bb80 0x55a80a68dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85cd88d740 4 client.15204 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a80a575d70 con 0x55a80a68bb80 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.249+0000 7f85c3fff640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a68bb80 0x55a80a68dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.250+0000 7f85a37fe640 10 client.15204 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.250+0000 7f85c3fff640 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a68bb80 0x55a80a68dfa0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ec8f4345b1ab8c server_cookie=f186a25335ff2edf in_seq=0 out_seq=0 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85a37fe640 1 -- 172.21.15.18:0/2470425241 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a80a575d70 con 0x55a80a68bb80 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85a37fe640 10 client.15204 handle_command_reply: tid=0 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 client.15204 shutdown 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 msgr2=0x55a80a61a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61a940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01dd00 tx=0x7f85bc011d70 comp rx=0 tx=0).stop 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 shutdown_connections 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55a80a68bb80 0x55a80a68dfa0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a80a610370 0x55a80a61a940 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a80a60b2e0 0x55a80a6199a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85a37fe640 0 client.15204 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 --2- 172.21.15.18:0/2470425241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80a60a9a0 0x55a80a619460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 >> 172.21.15.18:0/2470425241 conn(0x55a80a606010 msgr2=0x55a80a6049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 shutdown_connections 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 1 -- 172.21.15.18:0/2470425241 wait complete. 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.256+0000 7f85cd88d740 20 client.15204 trim_cache size 0 max 16384 2024-09-19T08:45:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:45:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:45:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:45:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f85ac0a32f0 msgr2=0x7f85ac0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f85ac0a32f0 0x7f85ac0a57b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85c406a980 tx=0x7f85bc007680 comp rx=0 tx=0).stop 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 msgr2=0x7f85c4199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c4199f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85b400d770 tx=0x7f85b400dc30 comp rx=0 tx=0).stop 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 shutdown_connections 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f85ac0a32f0 0x7f85ac0a57b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85c4107820 0x7f85c41a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85c4104ef0 0x7f85c419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 --2- 172.21.15.18:0/3157871937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85c41025c0 0x7f85c4199f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 >> 172.21.15.18:0/3157871937 conn(0x7f85c40fc1e0 msgr2=0x7f85c4101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 shutdown_connections 2024-09-19T08:45:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:45:51.257+0000 7f85caa1e640 1 -- 172.21.15.18:0/3157871937 wait complete. 2024-09-19T08:45:51.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:51 smithi162 ceph-mon[34870]: pgmap v366: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T08:45:51.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:51 smithi018 ceph-mon[30956]: pgmap v366: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T08:45:52.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:51 smithi150 ceph-mon[34610]: pgmap v366: 129 pgs: 129 active+clean; 658 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T08:45:53.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:53 smithi162 ceph-mon[34870]: pgmap v367: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T08:45:53.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:53 smithi018 ceph-mon[30956]: pgmap v367: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T08:45:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:53 smithi150 ceph-mon[34610]: pgmap v367: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T08:45:55.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:55 smithi162 ceph-mon[34870]: pgmap v368: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:45:55.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:55 smithi018 ceph-mon[30956]: pgmap v368: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:45:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:55 smithi150 ceph-mon[34610]: pgmap v368: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:45:57.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:57 smithi162 ceph-mon[34870]: pgmap v369: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:45:57.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:57 smithi018 ceph-mon[30956]: pgmap v369: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:45:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:57 smithi150 ceph-mon[34610]: pgmap v369: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:45:59.868 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:45:59 smithi150 ceph-mon[34610]: pgmap v370: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T08:45:59.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:45:59 smithi162 ceph-mon[34870]: pgmap v370: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T08:45:59.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:45:59 smithi018 ceph-mon[30956]: pgmap v370: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T08:46:01.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:01 smithi162 ceph-mon[34870]: pgmap v371: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:46:01.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:01 smithi018 ceph-mon[30956]: pgmap v371: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:46:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:01 smithi150 ceph-mon[34610]: pgmap v371: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:46:03.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:03 smithi162 ceph-mon[34870]: pgmap v372: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T08:46:03.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:03 smithi018 ceph-mon[30956]: pgmap v372: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T08:46:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:03 smithi150 ceph-mon[34610]: pgmap v372: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T08:46:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.388+0000 7fc2d4331640 1 -- 172.21.15.18:0/3263293975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc100a40 msgr2=0x7fc2cc100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.388+0000 7fc2d4331640 1 --2- 172.21.15.18:0/3263293975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc100a40 0x7fc2cc100e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009900 tx=0x7fc2c802a410 comp rx=0 tx=0).stop 2024-09-19T08:46:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.388+0000 7fc2d4331640 1 -- 172.21.15.18:0/3263293975 shutdown_connections 2024-09-19T08:46:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.388+0000 7fc2d4331640 1 --2- 172.21.15.18:0/3263293975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2cc1025f0 0x7fc2cc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.388+0000 7fc2d4331640 1 --2- 172.21.15.18:0/3263293975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc101c30 0x7fc2cc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.388+0000 7fc2d4331640 1 --2- 172.21.15.18:0/3263293975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc100a40 0x7fc2cc100e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.389+0000 7fc2d4331640 1 -- 172.21.15.18:0/3263293975 >> 172.21.15.18:0/3263293975 conn(0x7fc2cc0fc1e0 msgr2=0x7fc2cc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.389+0000 7fc2d4331640 1 -- 172.21.15.18:0/3263293975 shutdown_connections 2024-09-19T08:46:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.389+0000 7fc2d4331640 1 -- 172.21.15.18:0/3263293975 wait complete. 2024-09-19T08:46:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.389+0000 7fc2d4331640 1 Processor -- start 2024-09-19T08:46:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.389+0000 7fc2d4331640 1 -- start start 2024-09-19T08:46:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d4331640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 0x7fc2cc10b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d4331640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2cc101c30 0x7fc2cc109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d4331640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc1025f0 0x7fc2cc109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d4331640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc10d6c0 con 0x7fc2cc1025f0 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d4331640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc10d540 con 0x7fc2cc101c30 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d4331640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc10d840 con 0x7fc2cc100a40 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 0x7fc2cc10b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 0x7fc2cc10b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58696/0 (socket says 172.21.15.18:58696) 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2330722332 learned_addr learned my addr 172.21.15.18:0/2330722332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc1025f0 0x7fc2cc109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2cc101c30 0x7fc2cc109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2330722332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2cc101c30 msgr2=0x7fc2cc109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2cc101c30 0x7fc2cc109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc1025f0 msgr2=0x7fc2cc109f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc1025f0 0x7fc2cc109f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2330722332 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc10a7d0 con 0x7fc2cc100a40 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.390+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc1025f0 0x7fc2cc109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.391+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 0x7fc2cc10b3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80314e0 tx=0x7fc2c80042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.391+0000 7fc2c37fe640 1 -- 172.21.15.18:0/2330722332 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c803f030 con 0x7fc2cc100a40 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.391+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2cc1a1e20 con 0x7fc2cc100a40 2024-09-19T08:46:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.391+0000 7fc2c37fe640 1 -- 172.21.15.18:0/2330722332 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2c8003cb0 con 0x7fc2cc100a40 2024-09-19T08:46:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.391+0000 7fc2c37fe640 1 -- 172.21.15.18:0/2330722332 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8035070 con 0x7fc2cc100a40 2024-09-19T08:46:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.391+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2cc1a2280 con 0x7fc2cc100a40 2024-09-19T08:46:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.394+0000 7fc2c37fe640 1 -- 172.21.15.18:0/2330722332 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc2c8042030 con 0x7fc2cc100a40 2024-09-19T08:46:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.395+0000 7fc2c37fe640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc2b80a3370 0x7fc2b80a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.395+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc2b80a3370 0x7fc2b80a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.395+0000 7fc2c37fe640 1 -- 172.21.15.18:0/2330722332 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc2c80f0520 con 0x7fc2cc100a40 2024-09-19T08:46:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.395+0000 7fc2d70d1740 1 Processor -- start 2024-09-19T08:46:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.395+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc2b80a3370 0x7fc2b80a5830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc10b130 tx=0x7fc2bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 -- start start 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 0x55bc76e55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e562e0 0x55bc76e5ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e5d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bc76db92f0 con 0x55bc76e559a0 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bc76d61270 con 0x55bc76e5b370 2024-09-19T08:46:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc76db52b0 con 0x55bc76e562e0 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d20cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 0x55bc76e55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d20cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 0x55bc76e55da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47592/0 (socket says 172.21.15.18:47592) 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2932623400 learned_addr learned my addr 172.21.15.18:0/2932623400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.396+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e562e0 0x55bc76e5ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2932623400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e562e0 msgr2=0x55bc76e5ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e562e0 0x55bc76e5ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2932623400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 msgr2=0x55bc76e5d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e5d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d20cd640 1 -- 172.21.15.18:0/2932623400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc76d60340 con 0x55bc76e559a0 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e5d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 0x55bc76e55da0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80c4eb0 tx=0x7fc2c8004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65332ea871e655 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2c0bfe640 1 -- 172.21.15.18:0/2932623400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8049040 con 0x55bc76e559a0 2024-09-19T08:46:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2c0bfe640 1 -- 172.21.15.18:0/2932623400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2c80c53e0 con 0x55bc76e559a0 2024-09-19T08:46:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.397+0000 7fc2c0bfe640 1 -- 172.21.15.18:0/2932623400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c803bc90 con 0x55bc76e559a0 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2932623400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 msgr2=0x55bc76e55da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 0x55bc76e55da0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80c4eb0 tx=0x7fc2c8004590 comp rx=0 tx=0).stop 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2932623400 shutdown_connections 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e5d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e562e0 0x55bc76e5ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2932623400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e559a0 0x55bc76e55da0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2932623400 >> 172.21.15.18:0/2932623400 conn(0x55bc76e51010 msgr2=0x55bc76e51410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2932623400 shutdown_connections 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.398+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2932623400 wait complete. 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 -- start start 2024-09-19T08:46:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 Processor -- start 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e5f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e5fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d18cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e5fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d18cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e5fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47604/0 (socket says 172.21.15.18:47604) 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2129615474 learned_addr learned my addr 172.21.15.18:0/2129615474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e66ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bc76e5e100 con 0x55bc76e562e0 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bc76d42290 con 0x55bc76e559a0 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc76e5e280 con 0x55bc76e5b370 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e5f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.399+0000 7fc2d70d1740 10 client.0 _ll_register_callbacks cb 0x55bc76d73140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2129615474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 msgr2=0x55bc76e66ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e66ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e66ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 msgr2=0x55bc76e5f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e5f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc76acc210 con 0x55bc76e562e0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e5f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e66ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e5fea0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc003f70 tx=0x7fc2bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8125399161745d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2129615474 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc01e830 con 0x55bc76e562e0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2129615474 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc2bc01e9d0 con 0x55bc76e562e0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2c80c53e0 con 0x55bc76e562e0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2129615474 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc01ebd0 con 0x55bc76e562e0 2024-09-19T08:46:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d70d1740 10 client.15216 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.400+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bc76b98620 con 0x55bc76e562e0 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2129615474 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2bc01ed70 con 0x55bc76e562e0 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2129615474 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc2bc026020 con 0x55bc76e562e0 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d70d1740 10 client.15216 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d70d1740 10 client.15216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d70d1740 20 client.15216 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76e6b660 0x55bc76e6dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d70d1740 4 client.15216 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc2c80c53e0 con 0x55bc76e6b660 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.401+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76e6b660 0x55bc76e6dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.402+0000 7fc2b5ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.402+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76e6b660 0x55bc76e6dab0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e415ff33307691 server_cookie=1bd5e1367e12ded in_seq=0 out_seq=0 2024-09-19T08:46:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.402+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2129615474 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc2c80c53e0 con 0x55bc76e6b660 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.402+0000 7fc2b5ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.402+0000 7fc2d70d1740 1 client.15216 shutdown 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 msgr2=0x55bc76e5fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e5fea0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc003f70 tx=0x7fc2bc004730 comp rx=0 tx=0).stop 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 shutdown_connections 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76e6b660 0x55bc76e6dab0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e66ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e5fea0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2129615474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e5f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 >> 172.21.15.18:0/2129615474 conn(0x55bc76e51010 msgr2=0x55bc76e52820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2b5ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 shutdown_connections 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2129615474 wait complete. 2024-09-19T08:46:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.403+0000 7fc2d70d1740 20 client.15216 trim_cache size 0 max 16384 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.431+0000 7fc2d70d1740 1 Processor -- start 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.431+0000 7fc2d70d1740 1 -- start start 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.431+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e559a0 0x55bc76e513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.431+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e66ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e51ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1aa970 con 0x55bc76e562e0 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1ad1f0 con 0x55bc76e5b370 2024-09-19T08:46:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1aafe0 con 0x55bc76e559a0 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e66ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e66ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47618/0 (socket says 172.21.15.18:47618) 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 -- 172.21.15.18:0/105696088 learned_addr learned my addr 172.21.15.18:0/105696088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e559a0 0x55bc76e513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 -- 172.21.15.18:0/105696088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e559a0 msgr2=0x55bc76e513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e559a0 0x55bc76e513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 -- 172.21.15.18:0/105696088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 msgr2=0x55bc76e51ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e51ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 -- 172.21.15.18:0/105696088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc76e5a880 con 0x55bc76e562e0 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e66ea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc003f40 tx=0x7fc2bc0058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8e97f68efed483 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2b7fff640 1 -- 172.21.15.18:0/105696088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc03b020 con 0x55bc76e562e0 2024-09-19T08:46:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.432+0000 7fc2b7fff640 1 -- 172.21.15.18:0/105696088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2bc010660 con 0x55bc76e562e0 2024-09-19T08:46:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2b7fff640 1 -- 172.21.15.18:0/105696088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0376a0 con 0x55bc76e562e0 2024-09-19T08:46:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 -- 172.21.15.18:0/105696088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 msgr2=0x55bc76e66ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e66ea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc003f40 tx=0x7fc2bc0058f0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 -- 172.21.15.18:0/105696088 shutdown_connections 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e5b370 0x55bc76e51ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e66ea0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/105696088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e559a0 0x55bc76e513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 -- 172.21.15.18:0/105696088 >> 172.21.15.18:0/105696088 conn(0x55bc76e51010 msgr2=0x55bc76e575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 -- 172.21.15.18:0/105696088 shutdown_connections 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.433+0000 7fc2d70d1740 1 -- 172.21.15.18:0/105696088 wait complete. 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 -- start start 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 Processor -- start 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e64c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e65c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1ab6b0 con 0x55bc76e562e0 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1acb20 con 0x55bc76e559a0 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc1abd80 con 0x55bc76e5b370 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d70d1740 10 client.0 _ll_register_callbacks cb 0x7fc2bc003bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e64c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47622/0 (socket says 172.21.15.18:47622) 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2350125909 learned_addr learned my addr 172.21.15.18:0/2350125909 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d28ce640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e65c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2350125909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 msgr2=0x55bc76e65c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e65c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 msgr2=0x55bc76e646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.434+0000 7fc2d18cc640 1 -- 172.21.15.18:0/2350125909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc76e66240 con 0x55bc76e562e0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d18cc640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e64c20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc011fd0 tx=0x7fc2bc010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3727f5a46440eaed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2350125909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc003890 con 0x55bc76e562e0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2350125909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc2bc005250 con 0x55bc76e562e0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2bc010660 con 0x55bc76e562e0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2350125909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc0054b0 con 0x55bc76e562e0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d70d1740 10 client.15222 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bc76ed63f0 con 0x55bc76e562e0 2024-09-19T08:46:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2350125909 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2bc010660 con 0x55bc76e562e0 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2350125909 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc2bc026050 con 0x55bc76e562e0 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d70d1740 10 client.15222 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.435+0000 7fc2d70d1740 10 client.15222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2d70d1740 20 client.15222 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76ed6d80 0x55bc76ed91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2d70d1740 4 client.15222 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc76dc6a20 con 0x55bc76ed6d80 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76ed6d80 0x55bc76ed91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2d20cd640 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76ed6d80 0x55bc76ed91a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3558661da7cf570b server_cookie=c5fade259a34c2e8 in_seq=0 out_seq=0 2024-09-19T08:46:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.436+0000 7fc2b5ffb640 10 client.15222 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2b5ffb640 1 -- 172.21.15.18:0/2350125909 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc76dc6a20 con 0x55bc76ed6d80 2024-09-19T08:46:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2b5ffb640 10 client.15222 handle_command_reply: tid=0 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 client.15222 shutdown 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 msgr2=0x55bc76e64c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e64c20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc011fd0 tx=0x7fc2bc010cb0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 shutdown_connections 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc76ed6d80 0x55bc76ed91a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc76e5b370 0x55bc76e65c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc76e562e0 0x55bc76e64c20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2b5ffb640 0 client.15222 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 --2- 172.21.15.18:0/2350125909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc76e559a0 0x55bc76e646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 >> 172.21.15.18:0/2350125909 conn(0x55bc76e51010 msgr2=0x55bc76e4f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 shutdown_connections 2024-09-19T08:46:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 1 -- 172.21.15.18:0/2350125909 wait complete. 2024-09-19T08:46:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.440+0000 7fc2d70d1740 20 client.15222 trim_cache size 0 max 16384 2024-09-19T08:46:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:46:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:46:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:46:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc2b80a3370 msgr2=0x7fc2b80a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc2b80a3370 0x7fc2b80a5830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc10b130 tx=0x7fc2bc00b390 comp rx=0 tx=0).stop 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 msgr2=0x7fc2cc10b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 0x7fc2cc10b3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80314e0 tx=0x7fc2c80042e0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 shutdown_connections 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc2b80a3370 0x7fc2b80a5830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2cc1025f0 0x7fc2cc109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2cc101c30 0x7fc2cc109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 --2- 172.21.15.18:0/2330722332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2cc100a40 0x7fc2cc10b3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 >> 172.21.15.18:0/2330722332 conn(0x7fc2cc0fc1e0 msgr2=0x7fc2cc105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 shutdown_connections 2024-09-19T08:46:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:04.441+0000 7fc2d4331640 1 -- 172.21.15.18:0/2330722332 wait complete. 2024-09-19T08:46:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:05 smithi162 ceph-mon[34870]: pgmap v373: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:46:05.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:05 smithi018 ceph-mon[30956]: pgmap v373: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:46:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:05 smithi150 ceph-mon[34610]: pgmap v373: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:46:07.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:07 smithi162 ceph-mon[34870]: pgmap v374: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:46:07.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:07 smithi018 ceph-mon[30956]: pgmap v374: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:46:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:07 smithi150 ceph-mon[34610]: pgmap v374: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:46:09.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:09 smithi162 ceph-mon[34870]: pgmap v375: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:09.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:09 smithi018 ceph-mon[30956]: pgmap v375: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:09 smithi150 ceph-mon[34610]: pgmap v375: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:11.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:11 smithi162 ceph-mon[34870]: pgmap v376: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:11 smithi018 ceph-mon[30956]: pgmap v376: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:11 smithi150 ceph-mon[34610]: pgmap v376: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:13.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:13 smithi162 ceph-mon[34870]: pgmap v377: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:13.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:13 smithi018 ceph-mon[30956]: pgmap v377: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:13 smithi150 ceph-mon[34610]: pgmap v377: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:15.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:15 smithi162 ceph-mon[34870]: pgmap v378: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:15.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:15 smithi018 ceph-mon[30956]: pgmap v378: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:15 smithi150 ceph-mon[34610]: pgmap v378: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:16.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:16 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:16.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:16.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:17.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:17.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:17.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:16 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 -- 172.21.15.18:0/3959994350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 msgr2=0x7f44a0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 --2- 172.21.15.18:0/3959994350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a0109c90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4498009ca0 tx=0x7f449802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 -- 172.21.15.18:0/3959994350 shutdown_connections 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 --2- 172.21.15.18:0/3959994350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a0109c90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 --2- 172.21.15.18:0/3959994350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a0104ef0 0x7f44a01072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 --2- 172.21.15.18:0/3959994350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a01025c0 0x7f44a01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.537+0000 7f44a8253640 1 -- 172.21.15.18:0/3959994350 >> 172.21.15.18:0/3959994350 conn(0x7f44a00fc1e0 msgr2=0x7f44a00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.538+0000 7f44a8253640 1 -- 172.21.15.18:0/3959994350 shutdown_connections 2024-09-19T08:46:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.538+0000 7f44a8253640 1 -- 172.21.15.18:0/3959994350 wait complete. 2024-09-19T08:46:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.538+0000 7f44a8253640 1 Processor -- start 2024-09-19T08:46:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 -- start start 2024-09-19T08:46:17.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a01025c0 0x7f44a0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0104ef0 0x7f44a0198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a019f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a67f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a019f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a67f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a019f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49916/0 (socket says 172.21.15.18:49916) 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a67f0640 1 -- 172.21.15.18:0/833613104 learned_addr learned my addr 172.21.15.18:0/833613104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010d700 con 0x7f44a0107820 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a57ee640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0104ef0 0x7f44a0198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a5fef640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a01025c0 0x7f44a0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010d580 con 0x7f44a01025c0 2024-09-19T08:46:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010d880 con 0x7f44a0104ef0 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a57ee640 1 -- 172.21.15.18:0/833613104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a01025c0 msgr2=0x7f44a0197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a57ee640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a01025c0 0x7f44a0197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a57ee640 1 -- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 msgr2=0x7f44a019f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.539+0000 7f44a57ee640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a019f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f44a57ee640 1 -- 172.21.15.18:0/833613104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a019f940 con 0x7f44a0104ef0 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f44a57ee640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0104ef0 0x7f44a0198270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9c0 tx=0x7f449000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f4496ffd640 1 -- 172.21.15.18:0/833613104 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000cd80 con 0x7f44a0104ef0 2024-09-19T08:46:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f4496ffd640 1 -- 172.21.15.18:0/833613104 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44900035f0 con 0x7f44a0104ef0 2024-09-19T08:46:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a0100410 con 0x7f44a0104ef0 2024-09-19T08:46:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f4496ffd640 1 -- 172.21.15.18:0/833613104 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490010690 con 0x7f44a0104ef0 2024-09-19T08:46:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.540+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a0100960 con 0x7f44a0104ef0 2024-09-19T08:46:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.543+0000 7f4496ffd640 1 -- 172.21.15.18:0/833613104 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f44900037a0 con 0x7f44a0104ef0 2024-09-19T08:46:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.543+0000 7f4496ffd640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f448c0a3370 0x7f448c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.543+0000 7f44aafef740 1 Processor -- start 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.543+0000 7f44a5fef640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f448c0a3370 0x7f448c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f4496ffd640 1 -- 172.21.15.18:0/833613104 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f44900d0090 con 0x7f44a0104ef0 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 -- start start 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44a5fef640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f448c0a3370 0x7f448c0a5830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f44a0199200 tx=0x7f449c012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454ded6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dedbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454dedc370 0x56454dede830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56454de3a2f0 con 0x56454ded72e0 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56454dde2270 con 0x56454dedc370 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44aafef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56454de362b0 con 0x56454ded69a0 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.544+0000 7f44a57ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dedbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dedbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49932/0 (socket says 172.21.15.18:49932) 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 -- 172.21.15.18:0/2990048536 learned_addr learned my addr 172.21.15.18:0/2990048536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a5fef640 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454ded6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a67f0640 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454dedc370 0x56454dede830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 -- 172.21.15.18:0/2990048536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 msgr2=0x56454ded6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454ded6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 -- 172.21.15.18:0/2990048536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454dedc370 msgr2=0x56454dede830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454dedc370 0x56454dede830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 -- 172.21.15.18:0/2990048536 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56454dde1340 con 0x56454ded72e0 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a67f0640 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454dedc370 0x56454dede830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f44a57ee640 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dedbda0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4490098bc0 tx=0x7f449009bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f52c9c42b2fab26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f448bfff640 1 -- 172.21.15.18:0/2990048536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449009c980 con 0x56454ded72e0 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f448bfff640 1 -- 172.21.15.18:0/2990048536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f449009c280 con 0x56454ded72e0 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.545+0000 7f448bfff640 1 -- 172.21.15.18:0/2990048536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900a0170 con 0x56454ded72e0 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 -- 172.21.15.18:0/2990048536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 msgr2=0x56454dedbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dedbda0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4490098bc0 tx=0x7f449009bca0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 -- 172.21.15.18:0/2990048536 shutdown_connections 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454dedc370 0x56454dede830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dedbda0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 --2- 172.21.15.18:0/2990048536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454ded6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.546+0000 7f44aafef740 1 -- 172.21.15.18:0/2990048536 >> 172.21.15.18:0/2990048536 conn(0x56454ded2010 msgr2=0x56454ded2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.547+0000 7f44aafef740 1 -- 172.21.15.18:0/2990048536 shutdown_connections 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.547+0000 7f44aafef740 1 -- 172.21.15.18:0/2990048536 wait complete. 2024-09-19T08:46:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.547+0000 7f44aafef740 1 -- start start 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.547+0000 7f44aafef740 1 Processor -- start 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44aafef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454dee0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44aafef740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 0x56454dee10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44aafef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a67f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 0x56454dee10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a67f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49942/0 (socket says 172.21.15.18:49942) 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 0x56454dee10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:56642/0 (socket says 172.21.15.18:56642) 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 -- 172.21.15.18:0/1910048138 learned_addr learned my addr 172.21.15.18:0/1910048138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56454dedf340 con 0x56454dedc370 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56454ddc3290 con 0x56454ded72e0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56454dedf4c0 con 0x56454ded69a0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a5fef640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454dee0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 -- 172.21.15.18:0/1910048138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 msgr2=0x56454dee0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454dee0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 -- 172.21.15.18:0/1910048138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 msgr2=0x56454dee8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a57ee640 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56454db4d210 con 0x56454ded72e0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.548+0000 7f44a67f0640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44aafef740 10 client.0 _ll_register_callbacks cb 0x56454ddf4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f449009c280 con 0x56454ded72e0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44a57ee640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 0x56454dee10d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4490009230 tx=0x7f449009c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530c071aa91df8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44897fa640 10 client.24881 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44897fa640 1 -- 172.21.15.18:0/1910048138 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490080050 con 0x56454ded72e0 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44897fa640 1 -- 172.21.15.18:0/1910048138 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f44900a0370 con 0x56454ded72e0 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44897fa640 1 -- 172.21.15.18:0/1910048138 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f44900a4ef0 con 0x56454ded72e0 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44aafef740 10 client.24881 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.549+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({fsmap=21}) -- 0x56454dc19620 con 0x56454ded72e0 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44897fa640 1 -- 172.21.15.18:0/1910048138 <== mon.2 v2:172.21.15.150:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f44900bc050 con 0x56454ded72e0 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44aafef740 10 client.24881 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44aafef740 10 client.24881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44aafef740 20 client.24881 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44aafef740 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454deee570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44aafef740 4 client.24881 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56454de47a20 con 0x56454deec120 2024-09-19T08:46:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44a5fef640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454deee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44897fa640 10 client.24881 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.550+0000 7f44a5fef640 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454deee570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a404574da5d8f9 server_cookie=f4e49ea24746cfcf in_seq=0 out_seq=0 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44897fa640 1 -- 172.21.15.18:0/1910048138 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56454de47a20 con 0x56454deec120 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44897fa640 10 client.24881 handle_command_reply: tid=0 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44aafef740 1 client.24881 shutdown 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 msgr2=0x56454dee10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44aafef740 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 0x56454dee10d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4490009230 tx=0x7f449009c9a0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 shutdown_connections 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.551+0000 7f44aafef740 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454deee570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded72e0 0x56454dee10d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44897fa640 0 client.24881 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 1 --2- 172.21.15.18:0/1910048138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded69a0 0x56454dee0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 >> 172.21.15.18:0/1910048138 conn(0x56454ded2010 msgr2=0x56454ded3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 shutdown_connections 2024-09-19T08:46:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 1 -- 172.21.15.18:0/1910048138 wait complete. 2024-09-19T08:46:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.552+0000 7f44aafef740 20 client.24881 trim_cache size 0 max 16384 2024-09-19T08:46:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.580+0000 7f44aafef740 1 Processor -- start 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.580+0000 7f44aafef740 1 -- start start 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44aafef740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44aafef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dee80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44aafef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454dedc370 0x56454dee0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44aafef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a6510 con 0x56454ded72e0 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44aafef740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a8d90 con 0x56454ded69a0 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44aafef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a6b80 con 0x56454dedc370 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dee80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dee80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49948/0 (socket says 172.21.15.18:49948) 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 -- 172.21.15.18:0/451621503 learned_addr learned my addr 172.21.15.18:0/451621503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a5fef640 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a67f0640 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454dedc370 0x56454dee0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 -- 172.21.15.18:0/451621503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454dedc370 msgr2=0x56454dee0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454dedc370 0x56454dee0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 -- 172.21.15.18:0/451621503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 msgr2=0x56454dee0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 -- 172.21.15.18:0/451621503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56454dedc170 con 0x56454ded72e0 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a67f0640 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454dedc370 0x56454dee0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.581+0000 7f44a57ee640 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dee80d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4490000c00 tx=0x7f449009e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4de74f37e557c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.582+0000 7f448b7fe640 1 -- 172.21.15.18:0/451621503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490080070 con 0x56454ded72e0 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.582+0000 7f448b7fe640 1 -- 172.21.15.18:0/451621503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f449009c280 con 0x56454ded72e0 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.582+0000 7f448b7fe640 1 -- 172.21.15.18:0/451621503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900a03d0 con 0x56454ded72e0 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 -- 172.21.15.18:0/451621503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 msgr2=0x56454dee80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dee80d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4490000c00 tx=0x7f449009e000 comp rx=0 tx=0).stop 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 -- 172.21.15.18:0/451621503 shutdown_connections 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454dedc370 0x56454dee0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454ded72e0 0x56454dee80d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 --2- 172.21.15.18:0/451621503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 -- 172.21.15.18:0/451621503 >> 172.21.15.18:0/451621503 conn(0x56454ded2010 msgr2=0x56454ded84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 -- 172.21.15.18:0/451621503 shutdown_connections 2024-09-19T08:46:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 -- 172.21.15.18:0/451621503 wait complete. 2024-09-19T08:46:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 -- start start 2024-09-19T08:46:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.583+0000 7f44aafef740 1 Processor -- start 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded72e0 0x56454dee5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a5fef640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a7250 con 0x56454dedc370 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a86c0 con 0x56454ded69a0 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a5fef640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:56662/0 (socket says 172.21.15.18:56662) 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a5fef640 1 -- 172.21.15.18:0/3663705158 learned_addr learned my addr 172.21.15.18:0/3663705158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a7920 con 0x56454ded72e0 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a67f0640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a57ee640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded72e0 0x56454dee5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44aafef740 10 client.0 _ll_register_callbacks cb 0x7f449c01f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a5fef640 1 -- 172.21.15.18:0/3663705158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded72e0 msgr2=0x56454dee5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a5fef640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded72e0 0x56454dee5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.584+0000 7f44a5fef640 1 -- 172.21.15.18:0/3663705158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 msgr2=0x56454dee6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44a5fef640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44a5fef640 1 -- 172.21.15.18:0/3663705158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56454dee6d50 con 0x56454ded69a0 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44a67f0640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44a5fef640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee51f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f449c012010 tx=0x7f449c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae7cd73a5247f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44897fa640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44897fa640 1 -- 172.21.15.18:0/3663705158 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c022040 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f449009c280 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44897fa640 1 -- 172.21.15.18:0/3663705158 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f449c038680 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44897fa640 1 -- 172.21.15.18:0/3663705158 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f449c038880 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44aafef740 10 client.24887 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.585+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56454dee8160 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.586+0000 7f44897fa640 1 -- 172.21.15.18:0/3663705158 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f449009c280 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44897fa640 1 -- 172.21.15.18:0/3663705158 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f449c029550 con 0x56454ded69a0 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44aafef740 10 client.24887 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44aafef740 10 client.24887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44aafef740 20 client.24887 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44aafef740 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454df59290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44aafef740 4 client.24887 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56454ded7fd0 con 0x56454deec120 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44a57ee640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454df59290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44a57ee640 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454df59290 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf98a9aaa0f6b037 server_cookie=53863cf1d5fed03a in_seq=0 out_seq=0 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.587+0000 7f44897fa640 10 client.24887 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.590+0000 7f44897fa640 1 -- 172.21.15.18:0/3663705158 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56454ded7fd0 con 0x56454deec120 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.590+0000 7f44897fa640 10 client.24887 handle_command_reply: tid=0 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.590+0000 7f44aafef740 1 client.24887 shutdown 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 msgr2=0x56454dee51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee51f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f449c012010 tx=0x7f449c004730 comp rx=0 tx=0).stop 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 shutdown_connections 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56454deec120 0x56454df59290 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44897fa640 0 client.24887 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56454dedc370 0x56454dee6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56454ded72e0 0x56454dee5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 --2- 172.21.15.18:0/3663705158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56454ded69a0 0x56454dee51f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 >> 172.21.15.18:0/3663705158 conn(0x56454ded2010 msgr2=0x56454dee0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 shutdown_connections 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 1 -- 172.21.15.18:0/3663705158 wait complete. 2024-09-19T08:46:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.591+0000 7f44aafef740 20 client.24887 trim_cache size 0 max 16384 2024-09-19T08:46:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:46:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:46:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:46:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:46:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f448c0a3370 msgr2=0x7f448c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f448c0a3370 0x7f448c0a5830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f44a0199200 tx=0x7f449c012040 comp rx=0 tx=0).stop 2024-09-19T08:46:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0104ef0 msgr2=0x7f44a0198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0104ef0 0x7f44a0198270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9c0 tx=0x7f449000ee80 comp rx=0 tx=0).stop 2024-09-19T08:46:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 shutdown_connections 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f448c0a3370 0x7f448c0a5830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0107820 0x7f44a019f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0104ef0 0x7f44a0198270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 --2- 172.21.15.18:0/833613104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a01025c0 0x7f44a0197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 >> 172.21.15.18:0/833613104 conn(0x7f44a00fc1e0 msgr2=0x7f44a0102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 shutdown_connections 2024-09-19T08:46:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:17.592+0000 7f44a8253640 1 -- 172.21.15.18:0/833613104 wait complete. 2024-09-19T08:46:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:17 smithi162 ceph-mon[34870]: pgmap v379: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:17.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:17.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:17 smithi018 ceph-mon[30956]: pgmap v379: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:17.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:17 smithi150 ceph-mon[34610]: pgmap v379: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:46:19.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:19 smithi162 ceph-mon[34870]: pgmap v380: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:19.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:19 smithi018 ceph-mon[30956]: pgmap v380: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:20.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:19 smithi150 ceph-mon[34610]: pgmap v380: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:21.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:21 smithi162 ceph-mon[34870]: pgmap v381: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:46:21.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:21 smithi018 ceph-mon[30956]: pgmap v381: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:46:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:21 smithi150 ceph-mon[34610]: pgmap v381: 129 pgs: 129 active+clean; 660 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:46:23.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:23 smithi162 ceph-mon[34870]: pgmap v382: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:23.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:23 smithi018 ceph-mon[30956]: pgmap v382: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:23 smithi150 ceph-mon[34610]: pgmap v382: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:24.317 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 95% (12299/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.930 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:46:24.931 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T08:46:24.936 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T08:46:25.002 INFO:tasks.workunit.client.0.smithi018.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T08:46:25.004 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:46:25.004 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T08:46:25.766 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T08:46:25.832 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T08:46:25.873 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:46:25.875 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:46:25.875 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T08:46:25.915 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:46:25.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:25 smithi162 ceph-mon[34870]: pgmap v383: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:25.918 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:46:25.918 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T08:46:25.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:25 smithi018 ceph-mon[30956]: pgmap v383: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:25.959 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-19T08:46:25.961 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-19T08:46:25.962 DEBUG:teuthology.orchestra.run.smithi018:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-19T08:46:26.025 INFO:tasks.workunit.client.0.smithi018.stderr:+ set -e 2024-09-19T08:46:26.025 INFO:tasks.workunit.client.0.smithi018.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-19T08:46:26.029 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into 'xfstests-dev'... 2024-09-19T08:46:26.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:25 smithi150 ceph-mon[34610]: pgmap v383: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:27.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:27 smithi162 ceph-mon[34870]: pgmap v384: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:27.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:27 smithi018 ceph-mon[30956]: pgmap v384: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:27 smithi150 ceph-mon[34610]: pgmap v384: 129 pgs: 129 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:46:29.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:29 smithi162 ceph-mon[34870]: pgmap v385: 129 pgs: 129 active+clean; 811 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 13 KiB/s wr, 3 op/s 2024-09-19T08:46:29.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:29 smithi018 ceph-mon[30956]: pgmap v385: 129 pgs: 129 active+clean; 811 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 13 KiB/s wr, 3 op/s 2024-09-19T08:46:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:29 smithi150 ceph-mon[34610]: pgmap v385: 129 pgs: 129 active+clean; 811 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 13 KiB/s wr, 3 op/s 2024-09-19T08:46:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 -- 172.21.15.18:0/379333859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434102d50 msgr2=0x7ff4341031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 --2- 172.21.15.18:0/379333859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434102d50 0x7ff4341031d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff428009900 tx=0x7ff42802a410 comp rx=0 tx=0).stop 2024-09-19T08:46:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 -- 172.21.15.18:0/379333859 shutdown_connections 2024-09-19T08:46:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 --2- 172.21.15.18:0/379333859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff434103710 0x7ff434109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 --2- 172.21.15.18:0/379333859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434102d50 0x7ff4341031d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 --2- 172.21.15.18:0/379333859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434101b60 0x7ff434101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 -- 172.21.15.18:0/379333859 >> 172.21.15.18:0/379333859 conn(0x7ff4340fd2e0 msgr2=0x7ff4340ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 -- 172.21.15.18:0/379333859 shutdown_connections 2024-09-19T08:46:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.681+0000 7ff438e82640 1 -- 172.21.15.18:0/379333859 wait complete. 2024-09-19T08:46:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 Processor -- start 2024-09-19T08:46:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 -- start start 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 0x7ff434197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff434102d50 0x7ff434198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434103710 0x7ff43419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff43410d670 con 0x7ff434101b60 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff43410d4f0 con 0x7ff434103710 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff438e82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff43410d7f0 con 0x7ff434102d50 2024-09-19T08:46:30.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff43259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 0x7ff434197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff43259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 0x7ff434197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34808/0 (socket says 172.21.15.18:34808) 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434103710 0x7ff43419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.682+0000 7ff43259c640 1 -- 172.21.15.18:0/1989237988 learned_addr learned my addr 172.21.15.18:0/1989237988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff431d9b640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff434102d50 0x7ff434198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff43259c640 1 -- 172.21.15.18:0/1989237988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff434102d50 msgr2=0x7ff434198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff43259c640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff434102d50 0x7ff434198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff43259c640 1 -- 172.21.15.18:0/1989237988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434103710 msgr2=0x7ff43419f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff43259c640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434103710 0x7ff43419f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff43259c640 1 -- 172.21.15.18:0/1989237988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43419f930 con 0x7ff434101b60 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff43259c640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 0x7ff434197d20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff42400d770 tx=0x7ff42400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff4237fe640 1 -- 172.21.15.18:0/1989237988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424017070 con 0x7ff434101b60 2024-09-19T08:46:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff4237fe640 1 -- 172.21.15.18:0/1989237988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff424009c30 con 0x7ff434101b60 2024-09-19T08:46:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff4237fe640 1 -- 172.21.15.18:0/1989237988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424003d00 con 0x7ff434101b60 2024-09-19T08:46:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43419fc20 con 0x7ff434101b60 2024-09-19T08:46:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.683+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4341a0170 con 0x7ff434101b60 2024-09-19T08:46:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff4237fe640 1 -- 172.21.15.18:0/1989237988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff424003ea0 con 0x7ff434101b60 2024-09-19T08:46:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 Processor -- start 2024-09-19T08:46:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 -- start start 2024-09-19T08:46:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c6ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d97bc22f0 con 0x559d97c68780 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559d97b6a270 con 0x559d97c636f0 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43bc22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d97bbe2b0 con 0x559d97c62db0 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff431d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c6ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff431d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c6ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34818/0 (socket says 172.21.15.18:34818) 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff431d9b640 1 -- 172.21.15.18:0/2881486511 learned_addr learned my addr 172.21.15.18:0/2881486511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.686+0000 7ff43259c640 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff4237fe640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff41c0a32f0 0x7ff41c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff431d9b640 1 -- 172.21.15.18:0/2881486511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 msgr2=0x559d97c631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff431d9b640 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff431d9b640 1 -- 172.21.15.18:0/2881486511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 msgr2=0x559d97c681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff431d9b640 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff431d9b640 1 -- 172.21.15.18:0/2881486511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d97b69340 con 0x559d97c68780 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff43259c640 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff432d9d640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff41c0a32f0 0x7ff41c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff4237fe640 1 -- 172.21.15.18:0/1989237988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff4240cfa10 con 0x7ff434101b60 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff431d9b640 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c6ac40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff428009900 tx=0x7ff428005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176df5008a286d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff432d9d640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff41c0a32f0 0x7ff41c0a57b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff42c005fd0 tx=0x7ff42c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff420ff9640 1 -- 172.21.15.18:0/2881486511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428035030 con 0x559d97c68780 2024-09-19T08:46:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff420ff9640 1 -- 172.21.15.18:0/2881486511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff428040070 con 0x559d97c68780 2024-09-19T08:46:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.687+0000 7ff420ff9640 1 -- 172.21.15.18:0/2881486511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428003b80 con 0x559d97c68780 2024-09-19T08:46:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 -- 172.21.15.18:0/2881486511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 msgr2=0x559d97c6ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c6ac40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff428009900 tx=0x7ff428005c00 comp rx=0 tx=0).stop 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 -- 172.21.15.18:0/2881486511 shutdown_connections 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c6ac40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 --2- 172.21.15.18:0/2881486511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 -- 172.21.15.18:0/2881486511 >> 172.21.15.18:0/2881486511 conn(0x559d97c5a010 msgr2=0x559d97c5a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 -- 172.21.15.18:0/2881486511 shutdown_connections 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 -- 172.21.15.18:0/2881486511 wait complete. 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.688+0000 7ff43bc22740 1 -- start start 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 Processor -- start 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 0x559d97c6cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c636f0 0x559d97c6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c68780 0x559d97c74500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d97c6b6f0 con 0x559d97c62db0 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559d97b4b290 con 0x559d97c68780 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d97c6b870 con 0x559d97c636f0 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43bc22740 10 client.0 _ll_register_callbacks cb 0x559d97b7c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 0x559d97c6cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 0x559d97c6cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34820/0 (socket says 172.21.15.18:34820) 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 -- 172.21.15.18:0/4270795090 learned_addr learned my addr 172.21.15.18:0/4270795090 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff432d9d640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c68780 0x559d97c74500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff431d9b640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c636f0 0x559d97c6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 -- 172.21.15.18:0/4270795090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c636f0 msgr2=0x559d97c6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c636f0 0x559d97c6d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 -- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c68780 msgr2=0x559d97c74500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c68780 0x559d97c74500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 -- 172.21.15.18:0/4270795090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d978d5210 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff43259c640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 0x559d97c6cf80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff424009610 tx=0x7ff42400df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2edac6897f8286 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.689+0000 7ff419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff419ffb640 1 -- 172.21.15.18:0/4270795090 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424020030 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff419ffb640 1 -- 172.21.15.18:0/4270795090 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff4240a4440 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff428040070 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff419ffb640 1 -- 172.21.15.18:0/4270795090 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff424099e50 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 10 client.15252 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559d979a1620 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff419ffb640 1 -- 172.21.15.18:0/4270795090 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4240b1080 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff419ffb640 1 -- 172.21.15.18:0/4270795090 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff424004190 con 0x559d97c62db0 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 10 client.15252 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 10 client.15252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 20 client.15252 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97c78bf0 0x559d97c7b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 4 client.15252 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d97bcfa20 con 0x559d97c78bf0 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.690+0000 7ff431d9b640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97c78bf0 0x559d97c7b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.691+0000 7ff431d9b640 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97c78bf0 0x559d97c7b000 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c82ed23dd33aff5 server_cookie=f46233fce5041d2 in_seq=0 out_seq=0 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.691+0000 7ff419ffb640 10 client.15252 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff419ffb640 1 -- 172.21.15.18:0/4270795090 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d97bcfa20 con 0x559d97c78bf0 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff419ffb640 10 client.15252 handle_command_reply: tid=0 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 client.15252 shutdown 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 msgr2=0x559d97c6cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 0x559d97c6cf80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff424009610 tx=0x7ff42400df40 comp rx=0 tx=0).stop 2024-09-19T08:46:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 shutdown_connections 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97c78bf0 0x559d97c7b000 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c68780 0x559d97c74500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c636f0 0x559d97c6d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff419ffb640 0 client.15252 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 --2- 172.21.15.18:0/4270795090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c62db0 0x559d97c6cf80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 >> 172.21.15.18:0/4270795090 conn(0x559d97c5a010 msgr2=0x559d97c5b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 shutdown_connections 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 1 -- 172.21.15.18:0/4270795090 wait complete. 2024-09-19T08:46:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.692+0000 7ff43bc22740 20 client.15252 trim_cache size 0 max 16384 2024-09-19T08:46:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.706+0000 7ff43bc22740 1 Processor -- start 2024-09-19T08:46:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 -- start start 2024-09-19T08:46:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c6d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c5aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341a64c0 con 0x559d97c68780 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341a8d40 con 0x559d97c636f0 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43bc22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341a6b30 con 0x559d97c62db0 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c5aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c5aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34828/0 (socket says 172.21.15.18:34828) 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 -- 172.21.15.18:0/3595609393 learned_addr learned my addr 172.21.15.18:0/3595609393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff431d9b640 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43259c640 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c6d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 -- 172.21.15.18:0/3595609393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 msgr2=0x559d97c6d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c6d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 -- 172.21.15.18:0/3595609393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 msgr2=0x559d97c744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 -- 172.21.15.18:0/3595609393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d97c6cac0 con 0x559d97c68780 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff43259c640 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c6d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff432d9d640 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c5aec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff42c011600 tx=0x7ff42c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc08d5075f943f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.707+0000 7ff41bfff640 1 -- 172.21.15.18:0/3595609393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0104f0 con 0x559d97c68780 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff41bfff640 1 -- 172.21.15.18:0/3595609393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff42c010b40 con 0x559d97c68780 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff41bfff640 1 -- 172.21.15.18:0/3595609393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c01fcb0 con 0x559d97c68780 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 -- 172.21.15.18:0/3595609393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 msgr2=0x559d97c5aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c5aec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff42c011600 tx=0x7ff42c016000 comp rx=0 tx=0).stop 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 -- 172.21.15.18:0/3595609393 shutdown_connections 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c5aec0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3595609393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c6d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 -- 172.21.15.18:0/3595609393 >> 172.21.15.18:0/3595609393 conn(0x559d97c5a010 msgr2=0x559d97c6cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 -- 172.21.15.18:0/3595609393 shutdown_connections 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 -- 172.21.15.18:0/3595609393 wait complete. 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 -- start start 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.708+0000 7ff43bc22740 1 Processor -- start 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c71a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c71fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c72fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341a7200 con 0x559d97c68780 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341a8670 con 0x559d97c636f0 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341a78d0 con 0x559d97c62db0 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 10 client.0 _ll_register_callbacks cb 0x7ff4240046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c72fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c72fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34836/0 (socket says 172.21.15.18:34836) 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 -- 172.21.15.18:0/3427417395 learned_addr learned my addr 172.21.15.18:0/3427417395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff431d9b640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c71fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43259c640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c71a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 -- 172.21.15.18:0/3427417395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 msgr2=0x559d97c71a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c71a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 -- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 msgr2=0x559d97c71fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c71fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 -- 172.21.15.18:0/3427417395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d97c735c0 con 0x559d97c68780 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43259c640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c71a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff432d9d640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c72fb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff42c010cf0 tx=0x7ff42c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd0f1f36a36e14e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff419ffb640 1 -- 172.21.15.18:0/3427417395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c01fc40 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff419ffb640 1 -- 172.21.15.18:0/3427417395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff42c01fde0 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.709+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff42c010b40 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff419ffb640 1 -- 172.21.15.18:0/3427417395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff42c039050 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 10 client.15258 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559d97ce38b0 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff419ffb640 1 -- 172.21.15.18:0/3427417395 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff42c010b40 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff419ffb640 1 -- 172.21.15.18:0/3427417395 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff42c031020 con 0x559d97c68780 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 10 client.15258 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 10 client.15258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 20 client.15258 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97ce40f0 0x559d97ce6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 4 client.15258 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:46:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d97bc9d70 con 0x559d97ce40f0 2024-09-19T08:46:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.710+0000 7ff43259c640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97ce40f0 0x559d97ce6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.711+0000 7ff43259c640 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97ce40f0 0x559d97ce6510 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e75f730ab97e810 server_cookie=c93d0334646e53 in_seq=0 out_seq=0 2024-09-19T08:46:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.711+0000 7ff419ffb640 10 client.15258 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff419ffb640 1 -- 172.21.15.18:0/3427417395 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d97bc9d70 con 0x559d97ce40f0 2024-09-19T08:46:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff419ffb640 10 client.15258 handle_command_reply: tid=0 2024-09-19T08:46:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 client.15258 shutdown 2024-09-19T08:46:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 msgr2=0x559d97c72fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c72fb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff42c010cf0 tx=0x7ff42c010d20 comp rx=0 tx=0).stop 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 shutdown_connections 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559d97ce40f0 0x559d97ce6510 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d97c68780 0x559d97c72fb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff419ffb640 0 client.15258 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559d97c636f0 0x559d97c71fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 --2- 172.21.15.18:0/3427417395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d97c62db0 0x559d97c71a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 >> 172.21.15.18:0/3427417395 conn(0x559d97c5a010 msgr2=0x559d97c589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 shutdown_connections 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 1 -- 172.21.15.18:0/3427417395 wait complete. 2024-09-19T08:46:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.984+0000 7ff43bc22740 20 client.15258 trim_cache size 0 max 16384 2024-09-19T08:46:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:46:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:46:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:46:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff41c0a32f0 msgr2=0x7ff41c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff41c0a32f0 0x7ff41c0a57b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff42c005fd0 tx=0x7ff42c004a40 comp rx=0 tx=0).stop 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 msgr2=0x7ff434197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 0x7ff434197d20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff42400d770 tx=0x7ff42400dc30 comp rx=0 tx=0).stop 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 shutdown_connections 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff41c0a32f0 0x7ff41c0a57b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff434103710 0x7ff43419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff434102d50 0x7ff434198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 --2- 172.21.15.18:0/1989237988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff434101b60 0x7ff434197d20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 >> 172.21.15.18:0/1989237988 conn(0x7ff4340fd2e0 msgr2=0x7ff4341060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 shutdown_connections 2024-09-19T08:46:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:30.985+0000 7ff438e82640 1 -- 172.21.15.18:0/1989237988 wait complete. 2024-09-19T08:46:31.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:31 smithi162 ceph-mon[34870]: pgmap v386: 129 pgs: 129 active+clean; 6.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 472 KiB/s wr, 4 op/s 2024-09-19T08:46:31.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:31 smithi018 ceph-mon[30956]: pgmap v386: 129 pgs: 129 active+clean; 6.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 472 KiB/s wr, 4 op/s 2024-09-19T08:46:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:31 smithi150 ceph-mon[34610]: pgmap v386: 129 pgs: 129 active+clean; 6.2 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 472 KiB/s wr, 4 op/s 2024-09-19T08:46:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:33 smithi162 ceph-mon[34870]: pgmap v387: 129 pgs: 129 active+clean; 16 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-19T08:46:33.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:33 smithi018 ceph-mon[30956]: pgmap v387: 129 pgs: 129 active+clean; 16 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-19T08:46:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:33 smithi150 ceph-mon[34610]: pgmap v387: 129 pgs: 129 active+clean; 16 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2024-09-19T08:46:35.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:35 smithi018 ceph-mon[30956]: pgmap v388: 129 pgs: 129 active+clean; 17 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-09-19T08:46:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:35 smithi150 ceph-mon[34610]: pgmap v388: 129 pgs: 129 active+clean; 17 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-09-19T08:46:36.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:35 smithi162 ceph-mon[34870]: pgmap v388: 129 pgs: 129 active+clean; 17 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-09-19T08:46:37.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:37 smithi018 ceph-mon[30956]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2024-09-19T08:46:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:37 smithi150 ceph-mon[34610]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2024-09-19T08:46:38.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:37 smithi162 ceph-mon[34870]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2024-09-19T08:46:39.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:39 smithi018 ceph-mon[30956]: pgmap v390: 129 pgs: 129 active+clean; 19 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.6 MiB/s wr, 195 op/s 2024-09-19T08:46:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:39 smithi150 ceph-mon[34610]: pgmap v390: 129 pgs: 129 active+clean; 19 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.6 MiB/s wr, 195 op/s 2024-09-19T08:46:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:39 smithi162 ceph-mon[34870]: pgmap v390: 129 pgs: 129 active+clean; 19 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.6 MiB/s wr, 195 op/s 2024-09-19T08:46:41.815 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:41 smithi150 ceph-mon[34610]: pgmap v391: 129 pgs: 129 active+clean; 20 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T08:46:41.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:41 smithi018 ceph-mon[30956]: pgmap v391: 129 pgs: 129 active+clean; 20 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T08:46:42.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:41 smithi162 ceph-mon[34870]: pgmap v391: 129 pgs: 129 active+clean; 20 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T08:46:43.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:43 smithi018 ceph-mon[30956]: pgmap v392: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 1.5 MiB/s wr, 254 op/s 2024-09-19T08:46:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:43 smithi150 ceph-mon[34610]: pgmap v392: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 1.5 MiB/s wr, 254 op/s 2024-09-19T08:46:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 -- 172.21.15.18:0/752067050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 msgr2=0x7fdfd0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/752067050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0107380 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009900 tx=0x7fdfc402a410 comp rx=0 tx=0).stop 2024-09-19T08:46:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 -- 172.21.15.18:0/752067050 shutdown_connections 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/752067050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfd01078c0 0x7fdfd0109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/752067050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0107380 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/752067050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd0102660 0x7fdfd0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 -- 172.21.15.18:0/752067050 >> 172.21.15.18:0/752067050 conn(0x7fdfd00fc1e0 msgr2=0x7fdfd00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 -- 172.21.15.18:0/752067050 shutdown_connections 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.077+0000 7fdfd53fd640 1 -- 172.21.15.18:0/752067050 wait complete. 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 Processor -- start 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 -- start start 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfd0102660 0x7fdfd0101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd01078c0 0x7fdfd0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd010d710 con 0x7fdfd0104f90 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd010d590 con 0x7fdfd0102660 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfd53fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd010d890 con 0x7fdfd01078c0 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50218/0 (socket says 172.21.15.18:50218) 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2397252145 learned_addr learned my addr 172.21.15.18:0/2397252145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfceffd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfd0102660 0x7fdfd0101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd01078c0 0x7fdfd0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2397252145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd01078c0 msgr2=0x7fdfd0100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd01078c0 0x7fdfd0100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2397252145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfd0102660 msgr2=0x7fdfd0101fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfd0102660 0x7fdfd0101fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.078+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2397252145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd01013e0 con 0x7fdfd0104f90 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.079+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0100610 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40314e0 tx=0x7fdfc4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.079+0000 7fdfb7fff640 1 -- 172.21.15.18:0/2397252145 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc403f070 con 0x7fdfd0104f90 2024-09-19T08:46:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.079+0000 7fdfb7fff640 1 -- 172.21.15.18:0/2397252145 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc4031c40 con 0x7fdfd0104f90 2024-09-19T08:46:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.079+0000 7fdfb7fff640 1 -- 172.21.15.18:0/2397252145 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4035030 con 0x7fdfd0104f90 2024-09-19T08:46:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.079+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd01a1e50 con 0x7fdfd0104f90 2024-09-19T08:46:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.079+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd01a22b0 con 0x7fdfd0104f90 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfb7fff640 1 -- 172.21.15.18:0/2397252145 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdfc4042070 con 0x7fdfd0104f90 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 Processor -- start 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 -- start start 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad61fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6201da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad6204830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555ad61602f0 con 0x555ad6202370 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.081+0000 7fdfd827a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x555ad6108270 con 0x555ad61fc9a0 2024-09-19T08:46:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfd827a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555ad615c2b0 con 0x555ad61fd2e0 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad6204830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad6204830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50228/0 (socket says 172.21.15.18:50228) 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2392218842 learned_addr learned my addr 172.21.15.18:0/2392218842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad61fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfceffd640 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6201da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2392218842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 msgr2=0x555ad6201da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6201da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2392218842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 msgr2=0x555ad61fcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad61fcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 -- 172.21.15.18:0/2392218842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad6107340 con 0x555ad6202370 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad61fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfb7fff640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdfb80a32f0 0x7fdfb80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad6204830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40f8580 tx=0x7fdfc40f8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596e06bd27428f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdfb80a32f0 0x7fdfb80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfb7fff640 1 -- 172.21.15.18:0/2397252145 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdfc40f03f0 con 0x7fdfd0104f90 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfb57fa640 1 -- 172.21.15.18:0/2392218842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40b8990 con 0x555ad6202370 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfb57fa640 1 -- 172.21.15.18:0/2392218842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc40bc6f0 con 0x555ad6202370 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.082+0000 7fdfb57fa640 1 -- 172.21.15.18:0/2392218842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40bc050 con 0x555ad6202370 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 -- 172.21.15.18:0/2392218842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 msgr2=0x555ad6204830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdfb80a32f0 0x7fdfb80a57b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdfd006b3e0 tx=0x7fdfc8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad6204830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40f8580 tx=0x7fdfc40f8670 comp rx=0 tx=0).stop 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 -- 172.21.15.18:0/2392218842 shutdown_connections 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad6204830 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6201da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 --2- 172.21.15.18:0/2392218842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad61fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 -- 172.21.15.18:0/2392218842 >> 172.21.15.18:0/2392218842 conn(0x555ad61f8010 msgr2=0x555ad61f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 -- 172.21.15.18:0/2392218842 shutdown_connections 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 -- 172.21.15.18:0/2392218842 wait complete. 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.083+0000 7fdfd827a740 1 -- start start 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 Processor -- start 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad6206970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6206eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad620de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555ad6205100 con 0x555ad6202370 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x555ad60e9290 con 0x555ad61fc9a0 2024-09-19T08:46:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555ad6205280 con 0x555ad61fd2e0 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfd827a740 10 client.0 _ll_register_callbacks cb 0x555ad611a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad620de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad620de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50230/0 (socket says 172.21.15.18:50230) 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 -- 172.21.15.18:0/1248121864 learned_addr learned my addr 172.21.15.18:0/1248121864 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6206eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfceffd640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad6206970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 -- 172.21.15.18:0/1248121864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 msgr2=0x555ad6206eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6206eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 -- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 msgr2=0x555ad6206970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad6206970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 -- 172.21.15.18:0/1248121864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ad5e73210 con 0x555ad6202370 2024-09-19T08:46:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad620de80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80099e0 tx=0x7fdfc8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60899fe2549c543 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.084+0000 7fdfb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/1248121864 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800f7b0 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/1248121864 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdfc800f950 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc40bc6f0 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/1248121864 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdfc800fb50 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 10 client.15270 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555ad5f3f620 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/1248121864 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc40bc6f0 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/1248121864 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdfc8027070 con 0x555ad6202370 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 10 client.15270 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 10 client.15270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 20 client.15270 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6212620 0x555ad6214ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 4 client.15270 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ad616da20 con 0x555ad6212620 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.085+0000 7fdfceffd640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6212620 0x555ad6214ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.086+0000 7fdfceffd640 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6212620 0x555ad6214ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=657ccad931e15e12 server_cookie=4daba07cc6bd6fc1 in_seq=0 out_seq=0 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.086+0000 7fdfb2ff5640 10 client.15270 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.086+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/1248121864 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ad616da20 con 0x555ad6212620 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.086+0000 7fdfb2ff5640 10 client.15270 handle_command_reply: tid=0 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 client.15270 shutdown 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 msgr2=0x555ad620de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad620de80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80099e0 tx=0x7fdfc8004ab0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 shutdown_connections 2024-09-19T08:46:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6212620 0x555ad6214ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad6202370 0x555ad620de80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad6206eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfb2ff5640 0 client.15270 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1248121864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61fc9a0 0x555ad6206970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 >> 172.21.15.18:0/1248121864 conn(0x555ad61f8010 msgr2=0x555ad61f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 shutdown_connections 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 1 -- 172.21.15.18:0/1248121864 wait complete. 2024-09-19T08:46:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.087+0000 7fdfd827a740 20 client.15270 trim_cache size 0 max 16384 2024-09-19T08:46:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 Processor -- start 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 -- start start 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad61f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad62193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd01aa9d0 con 0x555ad61fc9a0 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd01ad250 con 0x555ad61f8010 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfd827a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd01ab040 con 0x555ad61fd2e0 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50234/0 (socket says 172.21.15.18:50234) 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.101+0000 7fdfce7fc640 1 -- 172.21.15.18:0/1353628143 learned_addr learned my addr 172.21.15.18:0/1353628143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad62193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfceffd640 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad61f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfce7fc640 1 -- 172.21.15.18:0/1353628143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 msgr2=0x555ad62193b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad62193b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfce7fc640 1 -- 172.21.15.18:0/1353628143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 msgr2=0x555ad61f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad61f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfce7fc640 1 -- 172.21.15.18:0/1353628143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad6215130 con 0x555ad61fc9a0 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfceffd640 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad61f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620dda0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4000c00 tx=0x7fdfc4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc008d8520970720 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfb4ff9640 1 -- 172.21.15.18:0/1353628143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4049040 con 0x555ad61fc9a0 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfb4ff9640 1 -- 172.21.15.18:0/1353628143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc40f3ca0 con 0x555ad61fc9a0 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfb4ff9640 1 -- 172.21.15.18:0/1353628143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40bc230 con 0x555ad61fc9a0 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 -- 172.21.15.18:0/1353628143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 msgr2=0x555ad620dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620dda0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4000c00 tx=0x7fdfc4005c90 comp rx=0 tx=0).stop 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 -- 172.21.15.18:0/1353628143 shutdown_connections 2024-09-19T08:46:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad62193b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620dda0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 --2- 172.21.15.18:0/1353628143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad61f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 -- 172.21.15.18:0/1353628143 >> 172.21.15.18:0/1353628143 conn(0x555ad6201ec0 msgr2=0x555ad61f69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.102+0000 7fdfd827a740 1 -- 172.21.15.18:0/1353628143 shutdown_connections 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 -- 172.21.15.18:0/1353628143 wait complete. 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 -- start start 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 Processor -- start 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad620b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad620cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd01ab710 con 0x555ad61fc9a0 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd01acb80 con 0x555ad61f8010 2024-09-19T08:46:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd01abde0 con 0x555ad61fd2e0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfd827a740 10 client.0 _ll_register_callbacks cb 0x7fdfc8009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfce7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50238/0 (socket says 172.21.15.18:50238) 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfce7fc640 1 -- 172.21.15.18:0/3414815935 learned_addr learned my addr 172.21.15.18:0/3414815935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfceffd640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad620b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.103+0000 7fdfcf7fe640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad620cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfce7fc640 1 -- 172.21.15.18:0/3414815935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 msgr2=0x555ad620cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad620cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfce7fc640 1 -- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 msgr2=0x555ad620b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad620b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfce7fc640 1 -- 172.21.15.18:0/3414815935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ad620d220 con 0x555ad61fc9a0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfceffd640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad620b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfce7fc640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620bc00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdfc402a9d0 tx=0x7fdfc40c09f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d58dabaf39f57ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/3414815935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40bc4c0 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/3414815935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdfc40ba9f0 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc40f3ca0 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/3414815935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdfc40bc230 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 10 client.15276 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555ad620d220 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/3414815935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc40f3ca0 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/3414815935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdfc403b5d0 con 0x555ad61fc9a0 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 10 client.15276 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 10 client.15276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 20 client.15276 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6202370 0x555ad627f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 4 client.15276 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:46:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.104+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ad6167d70 con 0x555ad6202370 2024-09-19T08:46:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.105+0000 7fdfceffd640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6202370 0x555ad627f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.105+0000 7fdfb2ff5640 10 client.15276 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.105+0000 7fdfceffd640 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6202370 0x555ad627f910 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=679b2229d554cf03 server_cookie=8b6db5d6f1c5efb6 in_seq=0 out_seq=0 2024-09-19T08:46:44.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:43 smithi162 ceph-mon[34870]: pgmap v392: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 1.5 MiB/s wr, 254 op/s 2024-09-19T08:46:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfb2ff5640 1 -- 172.21.15.18:0/3414815935 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ad6167d70 con 0x555ad6202370 2024-09-19T08:46:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfb2ff5640 10 client.15276 handle_command_reply: tid=0 2024-09-19T08:46:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 client.15276 shutdown 2024-09-19T08:46:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 msgr2=0x555ad620bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620bc00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdfc402a9d0 tx=0x7fdfc40c09f0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 shutdown_connections 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555ad6202370 0x555ad627f910 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ad61fd2e0 0x555ad620cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfb2ff5640 0 client.15276 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ad61fc9a0 0x555ad620bc00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 --2- 172.21.15.18:0/3414815935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555ad61f8010 0x555ad620b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 >> 172.21.15.18:0/3414815935 conn(0x555ad6201ec0 msgr2=0x555ad61f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 shutdown_connections 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 1 -- 172.21.15.18:0/3414815935 wait complete. 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.916+0000 7fdfd827a740 20 client.15276 trim_cache size 0 max 16384 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:46:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:46:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:46:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:46:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdfb80a32f0 msgr2=0x7fdfb80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdfb80a32f0 0x7fdfb80a57b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdfd006b3e0 tx=0x7fdfc8009500 comp rx=0 tx=0).stop 2024-09-19T08:46:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 msgr2=0x7fdfd0100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0100610 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40314e0 tx=0x7fdfc4003c10 comp rx=0 tx=0).stop 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 shutdown_connections 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fdfb80a32f0 0x7fdfb80a57b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd01078c0 0x7fdfd0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfd0104f90 0x7fdfd0100610 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 --2- 172.21.15.18:0/2397252145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfd0102660 0x7fdfd0101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 >> 172.21.15.18:0/2397252145 conn(0x7fdfd00fc1e0 msgr2=0x7fdfd0102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 shutdown_connections 2024-09-19T08:46:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:44.917+0000 7fdfd53fd640 1 -- 172.21.15.18:0/2397252145 wait complete. 2024-09-19T08:46:45.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:45 smithi018 ceph-mon[30956]: pgmap v393: 129 pgs: 129 active+clean; 23 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 680 KiB/s wr, 204 op/s 2024-09-19T08:46:46.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:45 smithi150 ceph-mon[34610]: pgmap v393: 129 pgs: 129 active+clean; 23 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 680 KiB/s wr, 204 op/s 2024-09-19T08:46:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:45 smithi162 ceph-mon[34870]: pgmap v393: 129 pgs: 129 active+clean; 23 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 680 KiB/s wr, 204 op/s 2024-09-19T08:46:47.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:47 smithi018 ceph-mon[30956]: pgmap v394: 129 pgs: 129 active+clean; 28 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.2 MiB/s wr, 611 op/s 2024-09-19T08:46:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:47 smithi150 ceph-mon[34610]: pgmap v394: 129 pgs: 129 active+clean; 28 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.2 MiB/s wr, 611 op/s 2024-09-19T08:46:48.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:47 smithi162 ceph-mon[34870]: pgmap v394: 129 pgs: 129 active+clean; 28 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.2 MiB/s wr, 611 op/s 2024-09-19T08:46:49.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:49 smithi018 ceph-mon[30956]: pgmap v395: 129 pgs: 129 active+clean; 25 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.2 MiB/s wr, 710 op/s 2024-09-19T08:46:50.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:49 smithi150 ceph-mon[34610]: pgmap v395: 129 pgs: 129 active+clean; 25 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.2 MiB/s wr, 710 op/s 2024-09-19T08:46:50.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:49 smithi162 ceph-mon[34870]: pgmap v395: 129 pgs: 129 active+clean; 25 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.2 MiB/s wr, 710 op/s 2024-09-19T08:46:51.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:51 smithi018 ceph-mon[30956]: pgmap v396: 129 pgs: 129 active+clean; 22 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.1 MiB/s wr, 861 op/s 2024-09-19T08:46:52.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:51 smithi150 ceph-mon[34610]: pgmap v396: 129 pgs: 129 active+clean; 22 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.1 MiB/s wr, 861 op/s 2024-09-19T08:46:52.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:51 smithi162 ceph-mon[34870]: pgmap v396: 129 pgs: 129 active+clean; 22 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.1 MiB/s wr, 861 op/s 2024-09-19T08:46:53.331 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 15% (670/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 24% (1053/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 30% (1333/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 38% (1693/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 47% (2049/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 53% (2348/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 62% (2737/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 69% (3040/4351) Updating files: 70% (3046/4351) Updating files: 70% (3071/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 79% (3479/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 89% (3876/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 95% (4139/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-19T08:46:53.340 INFO:tasks.workunit.client.0.smithi018.stderr:+ cd xfstests-dev 2024-09-19T08:46:53.346 INFO:tasks.workunit.client.0.smithi018.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-19T08:46:53.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:53 smithi018 ceph-mon[30956]: pgmap v397: 129 pgs: 129 active+clean; 26 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.4 MiB/s wr, 861 op/s 2024-09-19T08:46:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:53 smithi150 ceph-mon[34610]: pgmap v397: 129 pgs: 129 active+clean; 26 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.4 MiB/s wr, 861 op/s 2024-09-19T08:46:54.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:53 smithi162 ceph-mon[34870]: pgmap v397: 129 pgs: 129 active+clean; 26 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.4 MiB/s wr, 861 op/s 2024-09-19T08:46:55.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:55 smithi018 ceph-mon[30956]: pgmap v398: 129 pgs: 129 active+clean; 26 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 835 op/s 2024-09-19T08:46:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:55 smithi150 ceph-mon[34610]: pgmap v398: 129 pgs: 129 active+clean; 26 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 835 op/s 2024-09-19T08:46:56.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:55 smithi162 ceph-mon[34870]: pgmap v398: 129 pgs: 129 active+clean; 26 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 835 op/s 2024-09-19T08:46:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 -- 172.21.15.18:0/3088292199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 msgr2=0x7f1610108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 --2- 172.21.15.18:0/3088292199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f1610108e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1608009be0 tx=0x7f160802a6c0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 -- 172.21.15.18:0/3088292199 shutdown_connections 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 --2- 172.21.15.18:0/3088292199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f1610108e90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 --2- 172.21.15.18:0/3088292199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610101c40 0x7f16101020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 --2- 172.21.15.18:0/3088292199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1610100a50 0x7f1610100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 -- 172.21.15.18:0/3088292199 >> 172.21.15.18:0/3088292199 conn(0x7f16100fc1b0 msgr2=0x7f16100fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 -- 172.21.15.18:0/3088292199 shutdown_connections 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.011+0000 7f1615531640 1 -- 172.21.15.18:0/3088292199 wait complete. 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 Processor -- start 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 -- start start 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 0x7f161006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1610101c40 0x7f161019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f161019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f161010c580 con 0x7f1610100a50 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f161010c400 con 0x7f1610102600 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f1615531640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f161010c700 con 0x7f1610101c40 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f160effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 0x7f161006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f160effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 0x7f161006ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42094/0 (socket says 172.21.15.18:42094) 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f160effd640 1 -- 172.21.15.18:0/1125648097 learned_addr learned my addr 172.21.15.18:0/1125648097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f160f7fe640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f161019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.012+0000 7f160e7fc640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1610101c40 0x7f161019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160effd640 1 -- 172.21.15.18:0/1125648097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1610101c40 msgr2=0x7f161019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160effd640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1610101c40 0x7f161019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160effd640 1 -- 172.21.15.18:0/1125648097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 msgr2=0x7f161019f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160effd640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f161019f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160effd640 1 -- 172.21.15.18:0/1125648097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161019f920 con 0x7f1610100a50 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160f7fe640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f161019f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f160effd640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 0x7f161006ae10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f160000e9c0 tx=0x7f160000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f15f7fff640 1 -- 172.21.15.18:0/1125648097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000cd80 con 0x7f1610100a50 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f15f7fff640 1 -- 172.21.15.18:0/1125648097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16000035f0 con 0x7f1610100a50 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161019fbb0 con 0x7f1610100a50 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f15f7fff640 1 -- 172.21.15.18:0/1125648097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600010690 con 0x7f1610100a50 2024-09-19T08:46:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.013+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101a00b0 con 0x7f1610100a50 2024-09-19T08:46:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.016+0000 7f15f7fff640 1 -- 172.21.15.18:0/1125648097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f16000037a0 con 0x7f1610100a50 2024-09-19T08:46:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 Processor -- start 2024-09-19T08:46:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 -- start start 2024-09-19T08:46:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cdcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ce1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204ce4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x565204c402f0 con 0x565204cdc9a0 2024-09-19T08:46:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x565204be8270 con 0x565204cdd2e0 2024-09-19T08:46:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f16182d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565204c3c2b0 con 0x565204ce2370 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f160effd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ce1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f160f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cdcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f160f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cdcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42100/0 (socket says 172.21.15.18:42100) 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f160f7fe640 1 -- 172.21.15.18:0/729267605 learned_addr learned my addr 172.21.15.18:0/729267605 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f160e7fc640 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204ce4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.017+0000 7f15f7fff640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f15f80a32f0 0x7f15f80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160effd640 1 -- 172.21.15.18:0/729267605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 msgr2=0x565204ce4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160effd640 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204ce4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160effd640 1 -- 172.21.15.18:0/729267605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 msgr2=0x565204cdcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160effd640 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cdcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160effd640 1 -- 172.21.15.18:0/729267605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565204be7340 con 0x565204cdd2e0 2024-09-19T08:46:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160f7fe640 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cdcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160f7fe640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f15f80a32f0 0x7f15f80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f15f7fff640 1 -- 172.21.15.18:0/1125648097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f16000d0210 con 0x7f1610100a50 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160effd640 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ce1da0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16000cd910 tx=0x7f1600009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35146566c822fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f15f57fa640 1 -- 172.21.15.18:0/729267605 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160009c230 con 0x565204cdd2e0 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f15f57fa640 1 -- 172.21.15.18:0/729267605 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1600003b10 con 0x565204cdd2e0 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f15f57fa640 1 -- 172.21.15.18:0/729267605 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000213f0 con 0x565204cdd2e0 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.018+0000 7f160f7fe640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f15f80a32f0 0x7f15f80a57b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f16080307b0 tx=0x7f1608009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 -- 172.21.15.18:0/729267605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 msgr2=0x565204ce1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ce1da0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16000cd910 tx=0x7f1600009310 comp rx=0 tx=0).stop 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 -- 172.21.15.18:0/729267605 shutdown_connections 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204ce4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ce1da0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 --2- 172.21.15.18:0/729267605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cdcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 -- 172.21.15.18:0/729267605 >> 172.21.15.18:0/729267605 conn(0x565204cd8010 msgr2=0x565204cd8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 -- 172.21.15.18:0/729267605 shutdown_connections 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 -- 172.21.15.18:0/729267605 wait complete. 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 -- start start 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.019+0000 7f16182d3740 1 Processor -- start 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204ceaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ceb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x565204ce52e0 con 0x565204cdc9a0 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x565204bc9290 con 0x565204cdd2e0 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565204ce5460 con 0x565204ce2370 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f16182d3740 10 client.0 _ll_register_callbacks cb 0x565204bfa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204ceaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204ceaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42114/0 (socket says 172.21.15.18:42114) 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 -- 172.21.15.18:0/281781170 learned_addr learned my addr 172.21.15.18:0/281781170 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160e7fc640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ceb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160f7fe640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 -- 172.21.15.18:0/281781170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 msgr2=0x565204cf2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 -- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 msgr2=0x565204ceb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ceb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 -- 172.21.15.18:0/281781170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565204953210 con 0x565204cdc9a0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160f7fe640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f160effd640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204ceaef0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f16000cdcb0 tx=0x7f16000d3e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af01c47a818014 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f15f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.020+0000 7f15f2ff5640 1 -- 172.21.15.18:0/281781170 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160009bdc0 con 0x565204cdc9a0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f15f2ff5640 1 -- 172.21.15.18:0/281781170 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f160009a500 con 0x565204cdc9a0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565204c4da20 con 0x565204cdc9a0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f15f2ff5640 1 -- 172.21.15.18:0/281781170 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f16000b5050 con 0x565204cdc9a0 2024-09-19T08:46:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 10 client.15288 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565204a1f620 con 0x565204cdc9a0 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f15f2ff5640 1 -- 172.21.15.18:0/281781170 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x565204c4da20 con 0x565204cdc9a0 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f15f2ff5640 1 -- 172.21.15.18:0/281781170 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f16000b51f0 con 0x565204cdc9a0 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 10 client.15288 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 10 client.15288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 20 client.15288 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204cf6770 0x565204cf8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 4 client.15288 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.021+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565204c47d70 con 0x565204cf6770 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.022+0000 7f160e7fc640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204cf6770 0x565204cf8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.022+0000 7f15f2ff5640 10 client.15288 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.022+0000 7f160e7fc640 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204cf6770 0x565204cf8b60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d1d5c7510d3720 server_cookie=beb9cfb73703c25f in_seq=0 out_seq=0 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f15f2ff5640 1 -- 172.21.15.18:0/281781170 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565204c47d70 con 0x565204cf6770 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f15f2ff5640 10 client.15288 handle_command_reply: tid=0 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 client.15288 shutdown 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 msgr2=0x565204ceaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204ceaef0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f16000cdcb0 tx=0x7f16000d3e90 comp rx=0 tx=0).stop 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 shutdown_connections 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204cf6770 0x565204cf8b60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdd2e0 0x565204ceb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f15f2ff5640 0 client.15288 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 --2- 172.21.15.18:0/281781170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204ceaef0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 >> 172.21.15.18:0/281781170 conn(0x565204cd8010 msgr2=0x565204cd9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 shutdown_connections 2024-09-19T08:46:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.024+0000 7f16182d3740 1 -- 172.21.15.18:0/281781170 wait complete. 2024-09-19T08:46:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.025+0000 7f16182d3740 20 client.15288 trim_cache size 0 max 16384 2024-09-19T08:46:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.042+0000 7f16182d3740 1 Processor -- start 2024-09-19T08:46:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.042+0000 7f16182d3740 1 -- start start 2024-09-19T08:46:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f16182d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdc9a0 0x565204ceb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f16182d3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 0x565204ce1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f16182d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f16182d3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16101a6470 con 0x565204cdd2e0 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f16182d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16101a8d10 con 0x565204cdc9a0 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f16182d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16101a6b00 con 0x565204ce2370 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 0x565204ce1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 0x565204ce1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42124/0 (socket says 172.21.15.18:42124) 2024-09-19T08:46:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:36904/0 (socket says 172.21.15.18:36904) 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 -- 172.21.15.18:0/2079444538 learned_addr learned my addr 172.21.15.18:0/2079444538 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160effd640 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdc9a0 0x565204ceb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 -- 172.21.15.18:0/2079444538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 msgr2=0x565204cf2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 -- 172.21.15.18:0/2079444538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdc9a0 msgr2=0x565204ceb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdc9a0 0x565204ceb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 -- 172.21.15.18:0/2079444538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565204cd7e30 con 0x565204cdd2e0 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160f7fe640 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.043+0000 7f160e7fc640 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 0x565204ce1c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1604000c00 tx=0x7f1604009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8564cceea4039cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.044+0000 7f15f4ff9640 1 -- 172.21.15.18:0/2079444538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160401e6e0 con 0x565204cdd2e0 2024-09-19T08:46:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.044+0000 7f15f4ff9640 1 -- 172.21.15.18:0/2079444538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f160401ed30 con 0x565204cdd2e0 2024-09-19T08:46:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.044+0000 7f15f4ff9640 1 -- 172.21.15.18:0/2079444538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160401dd40 con 0x565204cdd2e0 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.044+0000 7f16182d3740 1 -- 172.21.15.18:0/2079444538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 msgr2=0x565204ce1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.044+0000 7f16182d3740 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 0x565204ce1c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1604000c00 tx=0x7f1604009260 comp rx=0 tx=0).stop 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.044+0000 7f16182d3740 1 -- 172.21.15.18:0/2079444538 shutdown_connections 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204ce2370 0x565204cf2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdd2e0 0x565204ce1c80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 --2- 172.21.15.18:0/2079444538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204cdc9a0 0x565204ceb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- 172.21.15.18:0/2079444538 >> 172.21.15.18:0/2079444538 conn(0x565204cd8010 msgr2=0x565204cd69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- 172.21.15.18:0/2079444538 shutdown_connections 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- 172.21.15.18:0/2079444538 wait complete. 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- start start 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 Processor -- start 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cef480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204cdd2e0 0x565204cef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204ce2370 0x565204cf09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16101a71d0 con 0x565204cdc9a0 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16101a8640 con 0x565204ce2370 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16101a78a0 con 0x565204cdd2e0 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f16182d3740 10 client.0 _ll_register_callbacks cb 0x7f1604005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f160effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f160effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42140/0 (socket says 172.21.15.18:42140) 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f160effd640 1 -- 172.21.15.18:0/3459556156 learned_addr learned my addr 172.21.15.18:0/3459556156 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f160f7fe640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204ce2370 0x565204cf09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.045+0000 7f160e7fc640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204cdd2e0 0x565204cef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160effd640 1 -- 172.21.15.18:0/3459556156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204cdd2e0 msgr2=0x565204cef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160effd640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204cdd2e0 0x565204cef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160effd640 1 -- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204ce2370 msgr2=0x565204cf09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160effd640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204ce2370 0x565204cf09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160effd640 1 -- 172.21.15.18:0/3459556156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565204cf0fe0 con 0x565204cdc9a0 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160f7fe640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204ce2370 0x565204cf09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f160effd640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cef480 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1600021000 tx=0x7f1600098790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75451fe6c5502e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f15f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:46:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f15f2ff5640 1 -- 172.21.15.18:0/3459556156 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160009bfa0 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f15f2ff5640 1 -- 172.21.15.18:0/3459556156 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1600098460 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f160401ed30 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f15f2ff5640 1 -- 172.21.15.18:0/3459556156 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f160009bdc0 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f16182d3740 10 client.15294 fetch_fsmap learned FSMap version 21 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.046+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565204cf22f0 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f15f2ff5640 1 -- 172.21.15.18:0/3459556156 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f160401ed30 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f15f2ff5640 1 -- 172.21.15.18:0/3459556156 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f16000d3a40 con 0x565204cdc9a0 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f16182d3740 10 client.15294 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f16182d3740 10 client.15294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f16182d3740 20 client.15294 populate_metadata read hostname 'smithi018' 2024-09-19T08:46:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f16182d3740 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204d61660 0x565204d63a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f16182d3740 4 client.15294 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:46:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565204bc4900 con 0x565204d61660 2024-09-19T08:46:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f160e7fc640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204d61660 0x565204d63a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f160e7fc640 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204d61660 0x565204d63a50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1ed550f61254f46 server_cookie=a2389aec5ba63fce in_seq=0 out_seq=0 2024-09-19T08:46:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:46:58.047+0000 7f15f2ff5640 10 client.15294 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:46:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:57 smithi150 ceph-mon[34610]: pgmap v399: 129 pgs: 129 active+clean; 27 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.4 MiB/s wr, 906 op/s 2024-09-19T08:46:58.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:57 smithi162 ceph-mon[34870]: pgmap v399: 129 pgs: 129 active+clean; 27 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.4 MiB/s wr, 906 op/s 2024-09-19T08:46:58.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:57 smithi018 ceph-mon[30956]: pgmap v399: 129 pgs: 129 active+clean; 27 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.4 MiB/s wr, 906 op/s 2024-09-19T08:46:59.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:46:59 smithi162 ceph-mon[34870]: pgmap v400: 129 pgs: 129 active+clean; 32 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 521 op/s 2024-09-19T08:47:00.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:46:59 smithi150 ceph-mon[34610]: pgmap v400: 129 pgs: 129 active+clean; 32 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 521 op/s 2024-09-19T08:47:00.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:46:59 smithi018 ceph-mon[30956]: pgmap v400: 129 pgs: 129 active+clean; 32 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 521 op/s 2024-09-19T08:47:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.796+0000 7f15f2ff5640 1 -- 172.21.15.18:0/3459556156 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565204bc4900 con 0x565204d61660 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.796+0000 7f15f2ff5640 10 client.15294 handle_command_reply: tid=0 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.796+0000 7f16182d3740 1 client.15294 shutdown 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.796+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 msgr2=0x565204cef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.796+0000 7f16182d3740 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cef480 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1600021000 tx=0x7f1600098790 comp rx=0 tx=0).stop 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 shutdown_connections 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x565204d61660 0x565204d63a50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565204ce2370 0x565204cf09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565204cdd2e0 0x565204cef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 --2- 172.21.15.18:0/3459556156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565204cdc9a0 0x565204cef480 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 >> 172.21.15.18:0/3459556156 conn(0x565204cd8010 msgr2=0x565204cd71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f15f2ff5640 0 client.15294 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 shutdown_connections 2024-09-19T08:47:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 1 -- 172.21.15.18:0/3459556156 wait complete. 2024-09-19T08:47:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f16182d3740 20 client.15294 trim_cache size 0 max 16384 2024-09-19T08:47:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:47:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:47:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:47:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f15f80a32f0 msgr2=0x7f15f80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f15f80a32f0 0x7f15f80a57b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f16080307b0 tx=0x7f1608009500 comp rx=0 tx=0).stop 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 msgr2=0x7f161006ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 0x7f161006ae10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f160000e9c0 tx=0x7f160000ee80 comp rx=0 tx=0).stop 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 shutdown_connections 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f15f80a32f0 0x7f15f80a57b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1610102600 0x7f161019f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1610101c40 0x7f161019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 --2- 172.21.15.18:0/1125648097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1610100a50 0x7f161006ae10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.797+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 >> 172.21.15.18:0/1125648097 conn(0x7f16100fc1b0 msgr2=0x7f1610104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.798+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 shutdown_connections 2024-09-19T08:47:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:00.798+0000 7f1615531640 1 -- 172.21.15.18:0/1125648097 wait complete. 2024-09-19T08:47:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:01 smithi150 ceph-mon[34610]: pgmap v401: 129 pgs: 129 active+clean; 34 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-09-19T08:47:02.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:01 smithi162 ceph-mon[34870]: pgmap v401: 129 pgs: 129 active+clean; 34 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-09-19T08:47:02.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:01 smithi018 ceph-mon[30956]: pgmap v401: 129 pgs: 129 active+clean; 34 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-09-19T08:47:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:03 smithi150 ceph-mon[34610]: pgmap v402: 129 pgs: 129 active+clean; 26 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 561 op/s 2024-09-19T08:47:04.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:03 smithi162 ceph-mon[34870]: pgmap v402: 129 pgs: 129 active+clean; 26 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 561 op/s 2024-09-19T08:47:04.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:03 smithi018 ceph-mon[30956]: pgmap v402: 129 pgs: 129 active+clean; 26 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 561 op/s 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T08:47:05.780 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T08:47:05.781 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-19T08:47:05.782 INFO:tasks.workunit.client.0.smithi018.stderr:+ make -j4 2024-09-19T08:47:05.802 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize -cfi 2024-09-19T08:47:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:05 smithi150 ceph-mon[34610]: pgmap v403: 129 pgs: 129 active+clean; 26 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.4 MiB/s wr, 604 op/s 2024-09-19T08:47:06.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:05 smithi162 ceph-mon[34870]: pgmap v403: 129 pgs: 129 active+clean; 26 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.4 MiB/s wr, 604 op/s 2024-09-19T08:47:06.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:05 smithi018 ceph-mon[30956]: pgmap v403: 129 pgs: 129 active+clean; 26 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.4 MiB/s wr, 604 op/s 2024-09-19T08:47:06.264 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-19T08:47:06.264 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './config.guess' 2024-09-19T08:47:06.305 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './config.sub' 2024-09-19T08:47:06.315 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './install-sh' 2024-09-19T08:47:06.326 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './ltmain.sh' 2024-09-19T08:47:06.362 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-19T08:47:06.363 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-19T08:47:06.372 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-19T08:47:06.383 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-19T08:47:06.392 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-19T08:47:06.402 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-19T08:47:06.410 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-19T08:47:06.412 INFO:tasks.workunit.client.0.smithi018.stdout:cp include/install-sh . 2024-09-19T08:47:06.424 INFO:tasks.workunit.client.0.smithi018.stdout:aclocal -I m4 2024-09-19T08:47:07.931 INFO:tasks.workunit.client.0.smithi018.stdout:autoheader 2024-09-19T08:47:07.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:07 smithi018 ceph-mon[30956]: pgmap v404: 129 pgs: 129 active+clean; 29 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 1.10k op/s 2024-09-19T08:47:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:07 smithi150 ceph-mon[34610]: pgmap v404: 129 pgs: 129 active+clean; 29 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 1.10k op/s 2024-09-19T08:47:08.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:07 smithi162 ceph-mon[34870]: pgmap v404: 129 pgs: 129 active+clean; 29 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 1.10k op/s 2024-09-19T08:47:08.437 INFO:tasks.workunit.client.0.smithi018.stdout:autoconf 2024-09-19T08:47:08.667 INFO:tasks.workunit.client.0.smithi018.stdout:./configure \ 2024-09-19T08:47:08.667 INFO:tasks.workunit.client.0.smithi018.stdout: --libexecdir=/usr/lib \ 2024-09-19T08:47:08.667 INFO:tasks.workunit.client.0.smithi018.stdout: --exec_prefix=/var/lib 2024-09-19T08:47:08.867 INFO:tasks.workunit.client.0.smithi018.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-19T08:47:08.867 INFO:tasks.workunit.client.0.smithi018.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-19T08:47:08.870 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to print strings... printf 2024-09-19T08:47:08.870 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc... gcc 2024-09-19T08:47:09.070 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether the C compiler works... yes 2024-09-19T08:47:09.071 INFO:tasks.workunit.client.0.smithi018.stdout:checking for C compiler default output file name... a.out 2024-09-19T08:47:09.133 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of executables... 2024-09-19T08:47:09.192 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are cross compiling... no 2024-09-19T08:47:09.245 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of object files... o 2024-09-19T08:47:09.369 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T08:47:09.508 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc accepts -g... yes 2024-09-19T08:47:09.977 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T08:47:09.983 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-19T08:47:09.989 INFO:tasks.workunit.client.0.smithi018.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T08:47:09.991 INFO:tasks.workunit.client.0.smithi018.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T08:47:09.993 INFO:tasks.workunit.client.0.smithi018.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-19T08:47:10.010 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-19T08:47:10.012 INFO:tasks.workunit.client.0.smithi018.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-19T08:47:10.054 INFO:tasks.workunit.client.0.smithi018.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-19T08:47:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:09 smithi150 ceph-mon[34610]: pgmap v405: 129 pgs: 129 active+clean; 36 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 1.09k op/s 2024-09-19T08:47:10.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:09 smithi162 ceph-mon[34870]: pgmap v405: 129 pgs: 129 active+clean; 36 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 1.09k op/s 2024-09-19T08:47:10.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:09 smithi018 ceph-mon[30956]: pgmap v405: 129 pgs: 129 active+clean; 36 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 1.09k op/s 2024-09-19T08:47:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:11 smithi150 ceph-mon[34610]: pgmap v406: 129 pgs: 129 active+clean; 36 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 1.15k op/s 2024-09-19T08:47:12.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:11 smithi162 ceph-mon[34870]: pgmap v406: 129 pgs: 129 active+clean; 36 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 1.15k op/s 2024-09-19T08:47:12.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:11 smithi018 ceph-mon[30956]: pgmap v406: 129 pgs: 129 active+clean; 36 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 1.15k op/s 2024-09-19T08:47:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 -- 172.21.15.18:0/2169980752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881003d0 msgr2=0x7f09881007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 --2- 172.21.15.18:0/2169980752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881003d0 0x7f09881007d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0984009900 tx=0x7f098402a410 comp rx=0 tx=0).stop 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 -- 172.21.15.18:0/2169980752 shutdown_connections 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 --2- 172.21.15.18:0/2169980752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881016b0 0x7f0988101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 --2- 172.21.15.18:0/2169980752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0988100d10 0x7f0988101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 --2- 172.21.15.18:0/2169980752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881003d0 0x7f09881007d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 -- 172.21.15.18:0/2169980752 >> 172.21.15.18:0/2169980752 conn(0x7f09880fc1e0 msgr2=0x7f09880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 -- 172.21.15.18:0/2169980752 shutdown_connections 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 -- 172.21.15.18:0/2169980752 wait complete. 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.899+0000 7f098f56f640 1 Processor -- start 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 -- start start 2024-09-19T08:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881003d0 0x7f0988199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0988100d10 0x7f098819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 0x7f09881a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f098810f900 con 0x7f09881016b0 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f098810f780 con 0x7f0988100d10 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098f56f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f098810fa80 con 0x7f09881003d0 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 0x7f09881a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 0x7f09881a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51010/0 (socket says 172.21.15.18:51010) 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 -- 172.21.15.18:0/1489292771 learned_addr learned my addr 172.21.15.18:0/1489292771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098d30b640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881003d0 0x7f0988199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0988100d10 0x7f098819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 -- 172.21.15.18:0/1489292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881003d0 msgr2=0x7f0988199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881003d0 0x7f0988199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 -- 172.21.15.18:0/1489292771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0988100d10 msgr2=0x7f098819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0988100d10 0x7f098819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098db0c640 1 -- 172.21.15.18:0/1489292771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09881a1b70 con 0x7f09881016b0 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.900+0000 7f098d30b640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881003d0 0x7f0988199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.901+0000 7f098db0c640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 0x7f09881a1500 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f098000eaa0 tx=0x7f098000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.901+0000 7f097e7fc640 1 -- 172.21.15.18:0/1489292771 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098000cdb0 con 0x7f09881016b0 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.901+0000 7f097e7fc640 1 -- 172.21.15.18:0/1489292771 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0980005020 con 0x7f09881016b0 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.901+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09881a1e60 con 0x7f09881016b0 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.901+0000 7f097e7fc640 1 -- 172.21.15.18:0/1489292771 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09800116d0 con 0x7f09881016b0 2024-09-19T08:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.901+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09881a23f0 con 0x7f09881016b0 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.903+0000 7f097e7fc640 1 -- 172.21.15.18:0/1489292771 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f09800051d0 con 0x7f09881016b0 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 Processor -- start 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 -- start start 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55789a0 0x5581d5578da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d557dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 0x5581d5580830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5581d54dc2f0 con 0x5581d557e370 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5581d5484270 con 0x5581d55792e0 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f09923e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581d54d82b0 con 0x5581d55789a0 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 0x5581d5580830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 0x5581d5580830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51024/0 (socket says 172.21.15.18:51024) 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 -- 172.21.15.18:0/1075783938 learned_addr learned my addr 172.21.15.18:0/1075783938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f097e7fc640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09740a3370 0x7f09740a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098d30b640 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d557dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55789a0 0x5581d5578da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098db0c640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09740a3370 0x7f09740a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 -- 172.21.15.18:0/1075783938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55789a0 msgr2=0x5581d5578da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55789a0 0x5581d5578da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 -- 172.21.15.18:0/1075783938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 msgr2=0x5581d557dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d557dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f098cb0a640 1 -- 172.21.15.18:0/1075783938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d5483340 con 0x5581d557e370 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.904+0000 7f097e7fc640 1 -- 172.21.15.18:0/1489292771 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f09800cff20 con 0x7f09881016b0 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.905+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 0x5581d5580830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f097800ad80 tx=0x7f097800a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edd8e17cbc3c970 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.905+0000 7f09737fe640 1 -- 172.21.15.18:0/1075783938 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097801b070 con 0x5581d557e370 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.905+0000 7f098db0c640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09740a3370 0x7f09740a5830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0980098ae0 tx=0x7f0980066aa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.905+0000 7f09737fe640 1 -- 172.21.15.18:0/1075783938 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f097800fdf0 con 0x5581d557e370 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.905+0000 7f09737fe640 1 -- 172.21.15.18:0/1075783938 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0978014650 con 0x5581d557e370 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 -- 172.21.15.18:0/1075783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 msgr2=0x5581d5580830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 0x5581d5580830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f097800ad80 tx=0x7f097800a490 comp rx=0 tx=0).stop 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 -- 172.21.15.18:0/1075783938 shutdown_connections 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d557e370 0x5581d5580830 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d557dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 --2- 172.21.15.18:0/1075783938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55789a0 0x5581d5578da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 -- 172.21.15.18:0/1075783938 >> 172.21.15.18:0/1075783938 conn(0x5581d5574010 msgr2=0x5581d5574410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 -- 172.21.15.18:0/1075783938 shutdown_connections 2024-09-19T08:47:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 -- 172.21.15.18:0/1075783938 wait complete. 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 -- start start 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.906+0000 7f09923e1740 1 Processor -- start 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5582bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d5583110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 0x5581d558a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5581d5581340 con 0x5581d55789a0 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5581d5465290 con 0x5581d55792e0 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581d55814c0 con 0x5581d557e370 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f09923e1740 10 client.0 _ll_register_callbacks cb 0x5581d5496140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5582bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5582bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51040/0 (socket says 172.21.15.18:51040) 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 -- 172.21.15.18:0/706793407 learned_addr learned my addr 172.21.15.18:0/706793407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098d30b640 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d5583110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 -- 172.21.15.18:0/706793407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 msgr2=0x5581d558a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 0x5581d558a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 -- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 msgr2=0x5581d5583110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d5583110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 -- 172.21.15.18:0/706793407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d51ef210 con 0x5581d55789a0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f098cb0a640 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5582bd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f09780169a0 tx=0x7f09780169d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8188697a3f6a3bad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f0970ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.907+0000 7f0970ff9640 1 -- 172.21.15.18:0/706793407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0978024020 con 0x5581d55789a0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f097800fdf0 con 0x5581d55789a0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f0970ff9640 1 -- 172.21.15.18:0/706793407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f0978016b70 con 0x5581d55789a0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f0970ff9640 1 -- 172.21.15.18:0/706793407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f097802f050 con 0x5581d55789a0 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 10 client.15306 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5581d52bb620 con 0x5581d55789a0 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f0970ff9640 1 -- 172.21.15.18:0/706793407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f097800fdf0 con 0x5581d55789a0 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f0970ff9640 1 -- 172.21.15.18:0/706793407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0978015040 con 0x5581d55789a0 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 10 client.15306 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 10 client.15306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 20 client.15306 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d558e570 0x5581d5590960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 4 client.15306 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.908+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581d54e9a20 con 0x5581d558e570 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.909+0000 7f098d30b640 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d558e570 0x5581d5590960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.909+0000 7f0970ff9640 10 client.15306 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.909+0000 7f098d30b640 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d558e570 0x5581d5590960 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c72d699dd042b88 server_cookie=8637d19d5c684399 in_seq=0 out_seq=0 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f0970ff9640 1 -- 172.21.15.18:0/706793407 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581d54e9a20 con 0x5581d558e570 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f0970ff9640 10 client.15306 handle_command_reply: tid=0 2024-09-19T08:47:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 client.15306 shutdown 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 msgr2=0x5581d5582bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5582bd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f09780169a0 tx=0x7f09780169d0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 shutdown_connections 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d558e570 0x5581d5590960 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 0x5581d558a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f0970ff9640 0 client.15306 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55792e0 0x5581d5583110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 --2- 172.21.15.18:0/706793407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5582bd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 >> 172.21.15.18:0/706793407 conn(0x5581d5574010 msgr2=0x5581d5575820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 shutdown_connections 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 1 -- 172.21.15.18:0/706793407 wait complete. 2024-09-19T08:47:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.910+0000 7f09923e1740 20 client.15306 trim_cache size 0 max 16384 2024-09-19T08:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 Processor -- start 2024-09-19T08:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 -- start start 2024-09-19T08:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55789a0 0x5581d55730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 0x5581d55735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 0x5581d558a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09881aaa60 con 0x5581d55792e0 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f09881ad2e0 con 0x5581d55789a0 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f09923e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09881ab0d0 con 0x5581d557e370 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 0x5581d55735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 0x5581d55735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51048/0 (socket says 172.21.15.18:51048) 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 -- 172.21.15.18:0/1095967448 learned_addr learned my addr 172.21.15.18:0/1095967448 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55789a0 0x5581d55730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 -- 172.21.15.18:0/1095967448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 msgr2=0x5581d558a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 0x5581d558a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 -- 172.21.15.18:0/1095967448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55789a0 msgr2=0x5581d55730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55789a0 0x5581d55730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098d30b640 1 -- 172.21.15.18:0/1095967448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d5573e30 con 0x5581d55792e0 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.925+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55789a0 0x5581d55730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f098d30b640 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 0x5581d55735f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0984009900 tx=0x7f09840058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cddb8dbedb1bb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f0972ffd640 1 -- 172.21.15.18:0/1095967448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984035040 con 0x5581d55792e0 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f0972ffd640 1 -- 172.21.15.18:0/1095967448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0984005040 con 0x5581d55792e0 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f0972ffd640 1 -- 172.21.15.18:0/1095967448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984004920 con 0x5581d55792e0 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 -- 172.21.15.18:0/1095967448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 msgr2=0x5581d55735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 0x5581d55735f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0984009900 tx=0x7f09840058b0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 -- 172.21.15.18:0/1095967448 shutdown_connections 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d557e370 0x5581d558a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55792e0 0x5581d55735f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 --2- 172.21.15.18:0/1095967448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d55789a0 0x5581d55730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 -- 172.21.15.18:0/1095967448 >> 172.21.15.18:0/1095967448 conn(0x5581d5574010 msgr2=0x5581d55729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.926+0000 7f09923e1740 1 -- 172.21.15.18:0/1095967448 shutdown_connections 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 -- 172.21.15.18:0/1095967448 wait complete. 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 -- start start 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 Processor -- start 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5587680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55792e0 0x5581d5587bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d557e370 0x5581d5588bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09881ab7a0 con 0x5581d55789a0 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f09881acc10 con 0x5581d557e370 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09881abe70 con 0x5581d55792e0 2024-09-19T08:47:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f09923e1740 10 client.0 _ll_register_callbacks cb 0x7f0978019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.927+0000 7f098cb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5587680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5587680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51056/0 (socket says 172.21.15.18:51056) 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 -- 172.21.15.18:0/1848683687 learned_addr learned my addr 172.21.15.18:0/1848683687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098d30b640 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55792e0 0x5581d5587bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 -- 172.21.15.18:0/1848683687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55792e0 msgr2=0x5581d5587bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55792e0 0x5581d5587bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 -- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d557e370 msgr2=0x5581d5588bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d557e370 0x5581d5588bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 -- 172.21.15.18:0/1848683687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d55891e0 con 0x5581d55789a0 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f098cb0a640 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5587680 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f09780205e0 tx=0x7f0978006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb50fe8497c07c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f0970ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:47:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f0970ff9640 1 -- 172.21.15.18:0/1848683687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0978038060 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f0970ff9640 1 -- 172.21.15.18:0/1848683687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f097800fd70 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0984005040 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f0970ff9640 1 -- 172.21.15.18:0/1848683687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f097803f050 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f09923e1740 10 client.15312 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.928+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5581d55f91a0 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f0970ff9640 1 -- 172.21.15.18:0/1848683687 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0984005040 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f0970ff9640 1 -- 172.21.15.18:0/1848683687 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0978014600 con 0x5581d55789a0 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f09923e1740 10 client.15312 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f09923e1740 10 client.15312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f09923e1740 20 client.15312 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f09923e1740 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d55f9990 0x5581d55fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f09923e1740 4 client.15312 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581d54e3d70 con 0x5581d55f9990 2024-09-19T08:47:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.929+0000 7f098d30b640 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d55f9990 0x5581d55fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.930+0000 7f098d30b640 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d55f9990 0x5581d55fbdb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e5581a4461070e2 server_cookie=754e7d4e92d124c3 in_seq=0 out_seq=0 2024-09-19T08:47:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:13.930+0000 7f0970ff9640 10 client.15312 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:14.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:13 smithi150 ceph-mon[34610]: pgmap v407: 129 pgs: 129 active+clean; 39 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.18k op/s 2024-09-19T08:47:14.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:13 smithi162 ceph-mon[34870]: pgmap v407: 129 pgs: 129 active+clean; 39 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.18k op/s 2024-09-19T08:47:14.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:13 smithi018 ceph-mon[30956]: pgmap v407: 129 pgs: 129 active+clean; 39 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.18k op/s 2024-09-19T08:47:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f0970ff9640 1 -- 172.21.15.18:0/1848683687 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581d54e3d70 con 0x5581d55f9990 2024-09-19T08:47:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f0970ff9640 10 client.15312 handle_command_reply: tid=0 2024-09-19T08:47:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 client.15312 shutdown 2024-09-19T08:47:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 msgr2=0x5581d5587680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5587680 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f09780205e0 tx=0x7f0978006a30 comp rx=0 tx=0).stop 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 shutdown_connections 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5581d55f9990 0x5581d55fbdb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f0970ff9640 0 client.15312 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5581d557e370 0x5581d5588bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d55792e0 0x5581d5587bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 --2- 172.21.15.18:0/1848683687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581d55789a0 0x5581d5587680 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.459+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 >> 172.21.15.18:0/1848683687 conn(0x5581d5574010 msgr2=0x5581d55731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 shutdown_connections 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f09923e1740 1 -- 172.21.15.18:0/1848683687 wait complete. 2024-09-19T08:47:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f09923e1740 20 client.15312 trim_cache size 0 max 16384 2024-09-19T08:47:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:47:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:47:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:47:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:47:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09740a3370 msgr2=0x7f09740a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09740a3370 0x7f09740a5830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0980098ae0 tx=0x7f0980066aa0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 msgr2=0x7f09881a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 0x7f09881a1500 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f098000eaa0 tx=0x7f098000ef60 comp rx=0 tx=0).stop 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 shutdown_connections 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f09740a3370 0x7f09740a5830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09881016b0 0x7f09881a1500 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0988100d10 0x7f098819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 --2- 172.21.15.18:0/1489292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09881003d0 0x7f0988199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.460+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 >> 172.21.15.18:0/1489292771 conn(0x7f09880fc1e0 msgr2=0x7f09880fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.461+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 shutdown_connections 2024-09-19T08:47:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:14.461+0000 7f098f56f640 1 -- 172.21.15.18:0/1489292771 wait complete. 2024-09-19T08:47:14.763 INFO:tasks.workunit.client.0.smithi018.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-19T08:47:14.763 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether ln -s works... yes 2024-09-19T08:47:14.776 INFO:tasks.workunit.client.0.smithi018.stdout:checking the maximum length of command line arguments... 1572864 2024-09-19T08:47:14.779 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-19T08:47:14.779 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-19T08:47:14.780 INFO:tasks.workunit.client.0.smithi018.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-19T08:47:14.781 INFO:tasks.workunit.client.0.smithi018.stdout:checking for objdump... objdump 2024-09-19T08:47:14.781 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to recognize dependent libraries... pass_all 2024-09-19T08:47:14.782 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dlltool... no 2024-09-19T08:47:14.782 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-19T08:47:14.783 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ar... ar 2024-09-19T08:47:14.894 INFO:tasks.workunit.client.0.smithi018.stdout:checking for archiver @FILE support... @ 2024-09-19T08:47:14.895 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strip... strip 2024-09-19T08:47:14.896 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ranlib... ranlib 2024-09-19T08:47:14.897 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gawk... gawk 2024-09-19T08:47:15.063 INFO:tasks.workunit.client.0.smithi018.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-19T08:47:15.064 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sysroot... no 2024-09-19T08:47:15.085 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a working dd... /usr/bin/dd 2024-09-19T08:47:15.103 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-19T08:47:15.144 INFO:tasks.workunit.client.0.smithi018.stdout:checking for mt... no 2024-09-19T08:47:15.163 INFO:tasks.workunit.client.0.smithi018.stdout:checking if : is a manifest tool... no 2024-09-19T08:47:15.279 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T08:47:15.556 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ANSI C header files... yes 2024-09-19T08:47:15.611 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/types.h... yes 2024-09-19T08:47:15.670 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/stat.h... yes 2024-09-19T08:47:15.730 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdlib.h... yes 2024-09-19T08:47:15.793 INFO:tasks.workunit.client.0.smithi018.stdout:checking for string.h... yes 2024-09-19T08:47:15.856 INFO:tasks.workunit.client.0.smithi018.stdout:checking for memory.h... yes 2024-09-19T08:47:15.921 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... yes 2024-09-19T08:47:15.983 INFO:tasks.workunit.client.0.smithi018.stdout:checking for inttypes.h... yes 2024-09-19T08:47:16.048 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdint.h... yes 2024-09-19T08:47:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:15 smithi150 ceph-mon[34610]: pgmap v408: 129 pgs: 129 active+clean; 39 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 815 op/s 2024-09-19T08:47:16.113 INFO:tasks.workunit.client.0.smithi018.stdout:checking for unistd.h... yes 2024-09-19T08:47:16.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:15 smithi162 ceph-mon[34870]: pgmap v408: 129 pgs: 129 active+clean; 39 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 815 op/s 2024-09-19T08:47:16.178 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dlfcn.h... yes 2024-09-19T08:47:16.189 INFO:tasks.workunit.client.0.smithi018.stdout:checking for objdir... .libs 2024-09-19T08:47:16.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:15 smithi018 ceph-mon[30956]: pgmap v408: 129 pgs: 129 active+clean; 39 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 815 op/s 2024-09-19T08:47:16.355 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-19T08:47:16.355 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-19T08:47:16.409 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-19T08:47:16.469 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc static flag -static works... no 2024-09-19T08:47:16.554 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc supports -c -o file.o... yes 2024-09-19T08:47:16.554 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-19T08:47:16.561 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-19T08:47:16.644 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether -lc should be explicitly linked in... no 2024-09-19T08:47:16.730 INFO:tasks.workunit.client.0.smithi018.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-19T08:47:16.730 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to hardcode library paths into programs... immediate 2024-09-19T08:47:16.732 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether stripping libraries is possible... yes 2024-09-19T08:47:16.733 INFO:tasks.workunit.client.0.smithi018.stdout:checking if libtool supports shared libraries... yes 2024-09-19T08:47:16.733 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether to build shared libraries... yes 2024-09-19T08:47:16.733 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether to build static libraries... yes 2024-09-19T08:47:16.741 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc... (cached) gcc 2024-09-19T08:47:16.804 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T08:47:16.804 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T08:47:16.805 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T08:47:16.806 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gmake... /usr/bin/gmake 2024-09-19T08:47:16.806 INFO:tasks.workunit.client.0.smithi018.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-19T08:47:16.806 INFO:tasks.workunit.client.0.smithi018.stdout:checking for tar... /bin/tar 2024-09-19T08:47:16.807 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gzip... /bin/gzip 2024-09-19T08:47:16.834 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc -MM is supported... yes 2024-09-19T08:47:16.835 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sort... /bin/sort 2024-09-19T08:47:16.835 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether ln -s works... yes 2024-09-19T08:47:16.836 INFO:tasks.workunit.client.0.smithi018.stdout:checking for rpm... /bin/rpm 2024-09-19T08:47:16.840 INFO:tasks.workunit.client.0.smithi018.stdout:checking for rpmbuild... no 2024-09-19T08:47:16.918 INFO:tasks.workunit.client.0.smithi018.stdout:checking assert.h usability... yes 2024-09-19T08:47:16.943 INFO:tasks.workunit.client.0.smithi018.stdout:checking assert.h presence... yes 2024-09-19T08:47:16.944 INFO:tasks.workunit.client.0.smithi018.stdout:checking for assert.h... yes 2024-09-19T08:47:17.022 INFO:tasks.workunit.client.0.smithi018.stdout:checking bstring.h usability... no 2024-09-19T08:47:17.070 INFO:tasks.workunit.client.0.smithi018.stdout:checking bstring.h presence... no 2024-09-19T08:47:17.071 INFO:tasks.workunit.client.0.smithi018.stdout:checking for bstring.h... no 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi018.stdout:checking libgen.h usability... yes 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi018.stdout:checking libgen.h presence... yes 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi018.stdout:checking for libgen.h... yes 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi018.stdout:checking dirent.h usability... yes 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi018.stdout:checking dirent.h presence... yes 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dirent.h... yes 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi018.stdout:checking errno.h usability... yes 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi018.stdout:checking errno.h presence... yes 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi018.stdout:checking for errno.h... yes 2024-09-19T08:47:17.432 INFO:tasks.workunit.client.0.smithi018.stdout:checking malloc.h usability... yes 2024-09-19T08:47:17.459 INFO:tasks.workunit.client.0.smithi018.stdout:checking malloc.h presence... yes 2024-09-19T08:47:17.459 INFO:tasks.workunit.client.0.smithi018.stdout:checking for malloc.h... yes 2024-09-19T08:47:17.543 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid.h usability... no 2024-09-19T08:47:17.587 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid.h presence... no 2024-09-19T08:47:17.587 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid.h... no 2024-09-19T08:47:17.658 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid/uuid.h usability... yes 2024-09-19T08:47:17.683 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid/uuid.h presence... yes 2024-09-19T08:47:17.683 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid/uuid.h... yes 2024-09-19T08:47:17.786 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/uuid.h usability... no 2024-09-19T08:47:17.829 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/uuid.h presence... no 2024-09-19T08:47:17.830 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/uuid.h... no 2024-09-19T08:47:17.896 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/file.h usability... yes 2024-09-19T08:47:17.920 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/file.h presence... yes 2024-09-19T08:47:17.920 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/file.h... yes 2024-09-19T08:47:17.992 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h usability... yes 2024-09-19T08:47:18.017 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h presence... yes 2024-09-19T08:47:18.018 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fcntl.h... yes 2024-09-19T08:47:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:17 smithi150 ceph-mon[34610]: pgmap v409: 129 pgs: 129 active+clean; 39 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 977 op/s 2024-09-19T08:47:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:17 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.098 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/syssgi.h usability... no 2024-09-19T08:47:18.143 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/syssgi.h presence... no 2024-09-19T08:47:18.143 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/syssgi.h... no 2024-09-19T08:47:18.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:17 smithi162 ceph-mon[34870]: pgmap v409: 129 pgs: 129 active+clean; 39 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 977 op/s 2024-09-19T08:47:18.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:18.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:17 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:17 smithi018 ceph-mon[30956]: pgmap v409: 129 pgs: 129 active+clean; 39 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 977 op/s 2024-09-19T08:47:18.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:18.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:18.238 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h usability... yes 2024-09-19T08:47:18.265 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h presence... yes 2024-09-19T08:47:18.265 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/param.h... yes 2024-09-19T08:47:18.288 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/stat.h... (cached) yes 2024-09-19T08:47:18.361 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/statvfs.h usability... yes 2024-09-19T08:47:18.383 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/statvfs.h presence... yes 2024-09-19T08:47:18.384 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/statvfs.h... yes 2024-09-19T08:47:18.451 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h usability... yes 2024-09-19T08:47:18.474 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h presence... yes 2024-09-19T08:47:18.474 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/time.h... yes 2024-09-19T08:47:18.649 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h usability... yes 2024-09-19T08:47:18.673 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h presence... yes 2024-09-19T08:47:18.673 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/ioctl.h... yes 2024-09-19T08:47:18.761 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/wait.h usability... yes 2024-09-19T08:47:18.803 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/wait.h presence... yes 2024-09-19T08:47:18.803 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/wait.h... yes 2024-09-19T08:47:18.829 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/types.h... (cached) yes 2024-09-19T08:47:18.848 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... (cached) yes 2024-09-19T08:47:18.914 INFO:tasks.workunit.client.0.smithi018.stdout:checking err.h usability... yes 2024-09-19T08:47:18.937 INFO:tasks.workunit.client.0.smithi018.stdout:checking err.h presence... yes 2024-09-19T08:47:18.938 INFO:tasks.workunit.client.0.smithi018.stdout:checking for err.h... yes 2024-09-19T08:47:19.004 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/falloc.h usability... yes 2024-09-19T08:47:19.026 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/falloc.h presence... yes 2024-09-19T08:47:19.026 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/falloc.h... yes 2024-09-19T08:47:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:19.102 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-19T08:47:19.145 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-19T08:47:19.145 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-19T08:47:19.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:19.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:19.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:19.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:19.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:47:19.207 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-19T08:47:19.248 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-19T08:47:19.249 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-19T08:47:19.308 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/platform_defs.h usability... no 2024-09-19T08:47:19.351 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/platform_defs.h presence... no 2024-09-19T08:47:19.352 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/platform_defs.h... no 2024-09-19T08:47:19.416 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfs/ioctl.h usability... no 2024-09-19T08:47:19.458 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfs/ioctl.h presence... no 2024-09-19T08:47:19.458 INFO:tasks.workunit.client.0.smithi018.stdout:checking for btrfs/ioctl.h... no 2024-09-19T08:47:19.518 INFO:tasks.workunit.client.0.smithi018.stdout:checking cifs/ioctl.h usability... no 2024-09-19T08:47:19.558 INFO:tasks.workunit.client.0.smithi018.stdout:checking cifs/ioctl.h presence... no 2024-09-19T08:47:19.558 INFO:tasks.workunit.client.0.smithi018.stdout:checking for cifs/ioctl.h... no 2024-09-19T08:47:19.679 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/mman.h usability... yes 2024-09-19T08:47:19.701 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/mman.h presence... yes 2024-09-19T08:47:19.702 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/mman.h... yes 2024-09-19T08:47:19.799 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/ext4.h usability... no 2024-09-19T08:47:19.841 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/ext4.h presence... no 2024-09-19T08:47:19.841 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/ext4.h... no 2024-09-19T08:47:19.882 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/xfs_log_format.h... no 2024-09-19T08:47:19.966 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid_compare... no 2024-09-19T08:47:20.033 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid_compare in -luuid... yes 2024-09-19T08:47:20.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:19 smithi150 ceph-mon[34610]: pgmap v410: 129 pgs: 129 active+clean; 32 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 1.3 MiB/s wr, 594 op/s 2024-09-19T08:47:20.151 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/xfs.h... yes 2024-09-19T08:47:20.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:19 smithi162 ceph-mon[34870]: pgmap v410: 129 pgs: 129 active+clean; 32 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 1.3 MiB/s wr, 594 op/s 2024-09-19T08:47:20.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:19 smithi018 ceph-mon[30956]: pgmap v410: 129 pgs: 129 active+clean; 32 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 1.3 MiB/s wr, 594 op/s 2024-09-19T08:47:20.195 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/libxfs.h... no 2024-09-19T08:47:20.239 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-19T08:47:20.288 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/xqm.h... yes 2024-09-19T08:47:20.367 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-19T08:47:20.416 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/handle.h usability... yes 2024-09-19T08:47:20.436 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/handle.h presence... yes 2024-09-19T08:47:20.437 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/handle.h... yes 2024-09-19T08:47:20.637 INFO:tasks.workunit.client.0.smithi018.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-19T08:47:20.693 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/acl.h usability... yes 2024-09-19T08:47:20.717 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/acl.h presence... yes 2024-09-19T08:47:20.717 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/acl.h... yes 2024-09-19T08:47:20.775 INFO:tasks.workunit.client.0.smithi018.stdout:checking acl/libacl.h usability... yes 2024-09-19T08:47:20.807 INFO:tasks.workunit.client.0.smithi018.stdout:checking acl/libacl.h presence... yes 2024-09-19T08:47:20.807 INFO:tasks.workunit.client.0.smithi018.stdout:checking for acl/libacl.h... yes 2024-09-19T08:47:20.873 INFO:tasks.workunit.client.0.smithi018.stdout:checking for acl_init in -lacl... yes 2024-09-19T08:47:20.930 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm-ndbm.h usability... no 2024-09-19T08:47:20.972 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm-ndbm.h presence... no 2024-09-19T08:47:20.973 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gdbm-ndbm.h... no 2024-09-19T08:47:21.024 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm/ndbm.h usability... no 2024-09-19T08:47:21.067 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm/ndbm.h presence... no 2024-09-19T08:47:21.067 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gdbm/ndbm.h... no 2024-09-19T08:47:21.120 INFO:tasks.workunit.client.0.smithi018.stdout:checking ndbm.h usability... no 2024-09-19T08:47:21.161 INFO:tasks.workunit.client.0.smithi018.stdout:checking ndbm.h presence... no 2024-09-19T08:47:21.161 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ndbm.h... no 2024-09-19T08:47:21.207 INFO:tasks.workunit.client.0.smithi018.stdout:checking libaio.h usability... yes 2024-09-19T08:47:21.233 INFO:tasks.workunit.client.0.smithi018.stdout:checking libaio.h presence... yes 2024-09-19T08:47:21.233 INFO:tasks.workunit.client.0.smithi018.stdout:checking for libaio.h... yes 2024-09-19T08:47:21.293 INFO:tasks.workunit.client.0.smithi018.stdout:checking liburing.h usability... no 2024-09-19T08:47:21.334 INFO:tasks.workunit.client.0.smithi018.stdout:checking liburing.h presence... no 2024-09-19T08:47:21.334 INFO:tasks.workunit.client.0.smithi018.stdout:checking for liburing.h... no 2024-09-19T08:47:21.386 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/capability.h usability... no 2024-09-19T08:47:21.426 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/capability.h presence... no 2024-09-19T08:47:21.426 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/capability.h... no 2024-09-19T08:47:21.475 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fiemap.h usability... yes 2024-09-19T08:47:21.497 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fiemap.h presence... yes 2024-09-19T08:47:21.497 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/fiemap.h... yes 2024-09-19T08:47:21.568 INFO:tasks.workunit.client.0.smithi018.stdout:checking for fallocate... yes 2024-09-19T08:47:21.642 INFO:tasks.workunit.client.0.smithi018.stdout:checking for open_by_handle_at... yes 2024-09-19T08:47:21.691 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fs.h usability... yes 2024-09-19T08:47:21.712 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fs.h presence... yes 2024-09-19T08:47:21.713 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/fs.h... yes 2024-09-19T08:47:21.774 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfsutil.h usability... no 2024-09-19T08:47:21.843 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfsutil.h presence... no 2024-09-19T08:47:21.843 INFO:tasks.workunit.client.0.smithi018.stdout:checking for btrfsutil.h... no 2024-09-19T08:47:21.908 INFO:tasks.workunit.client.0.smithi018.stdout:checking for copy_file_range... yes 2024-09-19T08:47:21.975 INFO:tasks.workunit.client.0.smithi018.stdout:checking for SEEK_DATA... yes 2024-09-19T08:47:22.057 INFO:tasks.workunit.client.0.smithi018.stdout:checking for BMV_OF_SHARED... yes 2024-09-19T08:47:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:21 smithi150 ceph-mon[34610]: pgmap v411: 129 pgs: 129 active+clean; 28 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 746 KiB/s wr, 608 op/s 2024-09-19T08:47:22.123 INFO:tasks.workunit.client.0.smithi018.stdout:checking for nftw... yes 2024-09-19T08:47:22.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:21 smithi162 ceph-mon[34870]: pgmap v411: 129 pgs: 129 active+clean; 28 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 746 KiB/s wr, 608 op/s 2024-09-19T08:47:22.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:21 smithi018 ceph-mon[30956]: pgmap v411: 129 pgs: 129 active+clean; 28 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 746 KiB/s wr, 608 op/s 2024-09-19T08:47:22.196 INFO:tasks.workunit.client.0.smithi018.stdout:checking for RLIMIT_NOFILE... yes 2024-09-19T08:47:22.258 INFO:tasks.workunit.client.0.smithi018.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-19T08:47:22.327 INFO:tasks.workunit.client.0.smithi018.stdout:checking for FICLONE... yes 2024-09-19T08:47:22.401 INFO:tasks.workunit.client.0.smithi018.stdout:checking for renameat2... yes 2024-09-19T08:47:22.468 INFO:tasks.workunit.client.0.smithi018.stdout:checking for reallocarray... yes 2024-09-19T08:47:22.550 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct mount_attr... yes 2024-09-19T08:47:22.642 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-19T08:47:22.726 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-19T08:47:22.829 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-19T08:47:22.911 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-19T08:47:22.993 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-19T08:47:23.079 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-19T08:47:23.161 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-19T08:47:23.218 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/btrfs.h usability... yes 2024-09-19T08:47:23.242 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/btrfs.h presence... yes 2024-09-19T08:47:23.242 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/btrfs.h... yes 2024-09-19T08:47:23.317 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-19T08:47:23.342 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-19T08:47:23.342 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/btrfs_tree.h... yes 2024-09-19T08:47:23.396 INFO:tasks.workunit.client.0.smithi018.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-19T08:47:23.440 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-19T08:47:23.467 INFO:tasks.workunit.client.0.smithi018.stdout:configure: creating ./config.status 2024-09-19T08:47:23.921 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating include/builddefs 2024-09-19T08:47:23.942 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating include/config.h 2024-09-19T08:47:23.960 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: executing libtool commands 2024-09-19T08:47:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:23 smithi150 ceph-mon[34610]: pgmap v412: 129 pgs: 129 active+clean; 30 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 813 KiB/s wr, 544 op/s 2024-09-19T08:47:24.127 INFO:tasks.workunit.client.0.smithi018.stdout:Building include 2024-09-19T08:47:24.128 INFO:tasks.workunit.client.0.smithi018.stdout:Building lib 2024-09-19T08:47:24.128 INFO:tasks.workunit.client.0.smithi018.stdout:Building tests 2024-09-19T08:47:24.148 INFO:tasks.workunit.client.0.smithi018.stdout: [LTDEP] 2024-09-19T08:47:24.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:23 smithi162 ceph-mon[34870]: pgmap v412: 129 pgs: 129 active+clean; 30 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 813 KiB/s wr, 544 op/s 2024-09-19T08:47:24.183 INFO:tasks.workunit.client.0.smithi018.stdout:Building ceph 2024-09-19T08:47:24.183 INFO:tasks.workunit.client.0.smithi018.stdout:Building btrfs 2024-09-19T08:47:24.183 INFO:tasks.workunit.client.0.smithi018.stdout:Building cifs 2024-09-19T08:47:24.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:23 smithi018 ceph-mon[30956]: pgmap v412: 129 pgs: 129 active+clean; 30 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 813 KiB/s wr, 544 op/s 2024-09-19T08:47:24.254 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-19T08:47:24.254 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-19T08:47:24.274 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-19T08:47:24.336 INFO:tasks.workunit.client.0.smithi018.stdout:Building ext4 2024-09-19T08:47:24.372 INFO:tasks.workunit.client.0.smithi018.stdout:Building f2fs 2024-09-19T08:47:24.391 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-19T08:47:24.412 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-19T08:47:24.508 INFO:tasks.workunit.client.0.smithi018.stdout:Building generic 2024-09-19T08:47:24.709 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-19T08:47:24.910 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dataascii.lo 2024-09-19T08:47:25.144 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] databin.lo 2024-09-19T08:47:25.169 INFO:tasks.workunit.client.0.smithi018.stdout:Building nfs 2024-09-19T08:47:25.210 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-19T08:47:25.288 INFO:tasks.workunit.client.0.smithi018.stdout:Building ocfs2 2024-09-19T08:47:25.327 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-19T08:47:25.404 INFO:tasks.workunit.client.0.smithi018.stdout:Building overlay 2024-09-19T08:47:25.462 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] datapid.lo 2024-09-19T08:47:25.470 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-19T08:47:25.723 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] file_lock.lo 2024-09-19T08:47:26.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:25 smithi150 ceph-mon[34610]: pgmap v413: 129 pgs: 129 active+clean; 30 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 422 KiB/s wr, 470 op/s 2024-09-19T08:47:26.089 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] forker.lo 2024-09-19T08:47:26.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:25 smithi162 ceph-mon[34870]: pgmap v413: 129 pgs: 129 active+clean; 30 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 422 KiB/s wr, 470 op/s 2024-09-19T08:47:26.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:25 smithi018 ceph-mon[30956]: pgmap v413: 129 pgs: 129 active+clean; 30 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 422 KiB/s wr, 470 op/s 2024-09-19T08:47:26.370 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] pattern.lo 2024-09-19T08:47:26.470 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] open_flags.lo 2024-09-19T08:47:26.582 INFO:tasks.workunit.client.0.smithi018.stdout:Building perf 2024-09-19T08:47:26.624 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-19T08:47:26.695 INFO:tasks.workunit.client.0.smithi018.stdout:Building selftest 2024-09-19T08:47:26.740 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-19T08:47:26.787 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] random_range.lo 2024-09-19T08:47:26.855 INFO:tasks.workunit.client.0.smithi018.stdout:Building shared 2024-09-19T08:47:26.898 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-19T08:47:26.989 INFO:tasks.workunit.client.0.smithi018.stdout:Building tmpfs 2024-09-19T08:47:27.029 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-19T08:47:27.035 INFO:tasks.workunit.client.0.smithi018.stdout:Building udf 2024-09-19T08:47:27.082 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-19T08:47:27.107 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] string_to_tokens.lo 2024-09-19T08:47:27.142 INFO:tasks.workunit.client.0.smithi018.stdout:Building xfs 2024-09-19T08:47:27.196 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] str_to_bytes.lo 2024-09-19T08:47:27.336 INFO:tasks.workunit.client.0.smithi018.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-19T08:47:27.337 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] tlibio.lo 2024-09-19T08:47:27.529 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] write_log.lo 2024-09-19T08:47:27.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.587+0000 7fcec2ffd640 1 -- 172.21.15.18:0/567649053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4031880 con 0x7fcec4101b60 2024-09-19T08:47:27.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 -- 172.21.15.18:0/567649053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4101b60 msgr2=0x7fcec4101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:27.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 --2- 172.21.15.18:0/567649053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4101b60 0x7fcec4101f60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009900 tx=0x7fceb402a3f0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 -- 172.21.15.18:0/567649053 shutdown_connections 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 --2- 172.21.15.18:0/567649053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4103710 0x7fcec4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 --2- 172.21.15.18:0/567649053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec4102d50 0x7fcec41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 --2- 172.21.15.18:0/567649053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4101b60 0x7fcec4101f60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 -- 172.21.15.18:0/567649053 >> 172.21.15.18:0/567649053 conn(0x7fcec40fd2e0 msgr2=0x7fcec40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 -- 172.21.15.18:0/567649053 shutdown_connections 2024-09-19T08:47:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.588+0000 7fceca366640 1 -- 172.21.15.18:0/567649053 wait complete. 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 Processor -- start 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 -- start start 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec4101b60 0x7fcec4075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 0x7fcec40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4103710 0x7fcec4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410d670 con 0x7fcec4103710 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410d4f0 con 0x7fcec4102d50 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.589+0000 7fceca366640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410d7f0 con 0x7fcec4101b60 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 0x7fcec40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 0x7fcec40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:47572/0 (socket says 172.21.15.18:47572) 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 -- 172.21.15.18:0/15668011 learned_addr learned my addr 172.21.15.18:0/15668011 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec8903640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4103710 0x7fcec4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec3fff640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec4101b60 0x7fcec4075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 -- 172.21.15.18:0/15668011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec4101b60 msgr2=0x7fcec4075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec4101b60 0x7fcec4075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 -- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4103710 msgr2=0x7fcec4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4103710 0x7fcec4074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 -- 172.21.15.18:0/15668011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40753b0 con 0x7fcec4102d50 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec8903640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4103710 0x7fcec4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.590+0000 7fcec37fe640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 0x7fcec40745e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9f0 tx=0x7fceb800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.591+0000 7fcec17fa640 1 -- 172.21.15.18:0/15668011 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb800cd80 con 0x7fcec4102d50 2024-09-19T08:47:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.591+0000 7fcec17fa640 1 -- 172.21.15.18:0/15668011 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fceb80108e0 con 0x7fcec4102d50 2024-09-19T08:47:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.591+0000 7fcec17fa640 1 -- 172.21.15.18:0/15668011 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8018920 con 0x7fcec4102d50 2024-09-19T08:47:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.591+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec41a1e40 con 0x7fcec4102d50 2024-09-19T08:47:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.591+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec41a2250 con 0x7fcec4102d50 2024-09-19T08:47:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.594+0000 7fcec17fa640 1 -- 172.21.15.18:0/15668011 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fceb8010a90 con 0x7fcec4102d50 2024-09-19T08:47:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.594+0000 7fcecd1de740 1 Processor -- start 2024-09-19T08:47:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 -- start start 2024-09-19T08:47:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d729a0 0x55c400d72da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d77da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d78370 0x55c400d7a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c400cd62f0 con 0x55c400d78370 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c400c7e270 con 0x55c400d732e0 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcecd1de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c400cd22b0 con 0x55c400d729a0 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d77da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d77da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:47580/0 (socket says 172.21.15.18:47580) 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 -- 172.21.15.18:0/2343032391 learned_addr learned my addr 172.21.15.18:0/2343032391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec8903640 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d729a0 0x55c400d72da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec17fa640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fceac0a32f0 0x7fceac0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec37fe640 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d78370 0x55c400d7a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 -- 172.21.15.18:0/2343032391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d729a0 msgr2=0x55c400d72da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d729a0 0x55c400d72da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 -- 172.21.15.18:0/2343032391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d78370 msgr2=0x55c400d7a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d78370 0x55c400d7a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.595+0000 7fcec3fff640 1 -- 172.21.15.18:0/2343032391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c400c7d340 con 0x55c400d732e0 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.596+0000 7fcec8903640 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d729a0 0x55c400d72da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.596+0000 7fcec8903640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fceac0a32f0 0x7fceac0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.596+0000 7fcec17fa640 1 -- 172.21.15.18:0/15668011 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fceb80d0020 con 0x7fcec4102d50 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.596+0000 7fcec3fff640 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d77da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009900 tx=0x7fceb4032b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebba30d56ad32226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.596+0000 7fceaa7fc640 1 -- 172.21.15.18:0/2343032391 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb403f070 con 0x55c400d732e0 2024-09-19T08:47:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.596+0000 7fceaa7fc640 1 -- 172.21.15.18:0/2343032391 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fceb4004030 con 0x55c400d732e0 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fceaa7fc640 1 -- 172.21.15.18:0/2343032391 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4035070 con 0x55c400d732e0 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 -- 172.21.15.18:0/2343032391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 msgr2=0x55c400d77da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcec8903640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fceac0a32f0 0x7fceac0a57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009fd0 tx=0x7fcebc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d77da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009900 tx=0x7fceb4032b00 comp rx=0 tx=0).stop 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 -- 172.21.15.18:0/2343032391 shutdown_connections 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d78370 0x55c400d7a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d77da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 --2- 172.21.15.18:0/2343032391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d729a0 0x55c400d72da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 -- 172.21.15.18:0/2343032391 >> 172.21.15.18:0/2343032391 conn(0x55c400d6e010 msgr2=0x55c400d6e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 -- 172.21.15.18:0/2343032391 shutdown_connections 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.597+0000 7fcecd1de740 1 -- 172.21.15.18:0/2343032391 wait complete. 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.598+0000 7fcecd1de740 1 -- start start 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.598+0000 7fcecd1de740 1 Processor -- start 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d7cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 0x55c400d7d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d78370 0x55c400d84120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c400d7b380 con 0x55c400d729a0 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c400c5f290 con 0x55c400d78370 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c400d7b500 con 0x55c400d732e0 2024-09-19T08:47:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcecd1de740 10 client.0 _ll_register_callbacks cb 0x55c400c90140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d7cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 0x55c400d7d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 0x55c400d7d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40736/0 (socket says 172.21.15.18:40736) 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 -- 172.21.15.18:0/389386340 learned_addr learned my addr 172.21.15.18:0/389386340 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec8903640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d78370 0x55c400d84120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 -- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d78370 msgr2=0x55c400d84120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d78370 0x55c400d84120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 -- 172.21.15.18:0/389386340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 msgr2=0x55c400d7cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d7cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec37fe640 1 -- 172.21.15.18:0/389386340 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4009e9210 con 0x55c400d732e0 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.599+0000 7fcec3fff640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d7cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcec37fe640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 0x55c400d7d0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fceb80cd750 tx=0x7fceb809beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6506eca9bf5125b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcea37fe640 1 -- 172.21.15.18:0/389386340 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80d2310 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcea37fe640 1 -- 172.21.15.18:0/389386340 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fceb80bc070 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb4004030 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcea37fe640 1 -- 172.21.15.18:0/389386340 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fceb80a4ee0 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcecd1de740 10 client.25042 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.600+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c400ab5620 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcea37fe640 1 -- 172.21.15.18:0/389386340 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fceb4004030 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcea37fe640 1 -- 172.21.15.18:0/389386340 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fceb809b6c0 con 0x55c400d732e0 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcecd1de740 10 client.25042 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcecd1de740 10 client.25042 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcecd1de740 20 client.25042 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcecd1de740 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400d88770 0x55c400d8aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcecd1de740 4 client.25042 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c400ce3a20 con 0x55c400d88770 2024-09-19T08:47:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcec3fff640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400d88770 0x55c400d8aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.601+0000 7fcea37fe640 10 client.25042 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.602+0000 7fcec3fff640 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400d88770 0x55c400d8aba0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56545c061fac477 server_cookie=7944d84248924f5c in_seq=0 out_seq=0 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.602+0000 7fcea37fe640 1 -- 172.21.15.18:0/389386340 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c400ce3a20 con 0x55c400d88770 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.602+0000 7fcea37fe640 10 client.25042 handle_command_reply: tid=0 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.602+0000 7fcecd1de740 1 client.25042 shutdown 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 msgr2=0x55c400d7d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 0x55c400d7d0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fceb80cd750 tx=0x7fceb809beb0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 shutdown_connections 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400d88770 0x55c400d8aba0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d78370 0x55c400d84120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d732e0 0x55c400d7d0e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 --2- 172.21.15.18:0/389386340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d7cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcea37fe640 0 client.25042 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 >> 172.21.15.18:0/389386340 conn(0x55c400d6e010 msgr2=0x55c400d6f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 shutdown_connections 2024-09-19T08:47:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 1 -- 172.21.15.18:0/389386340 wait complete. 2024-09-19T08:47:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.603+0000 7fcecd1de740 20 client.25042 trim_cache size 0 max 16384 2024-09-19T08:47:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 Processor -- start 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 -- start start 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d729a0 0x55c400d6eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d732e0 0x55c400d840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d6f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41aa8e0 con 0x55c400d732e0 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41ad160 con 0x55c400d729a0 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcecd1de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41aaf50 con 0x55c400d78370 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d732e0 0x55c400d840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d732e0 0x55c400d840e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52192/0 (socket says 172.21.15.18:52192) 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d729a0 0x55c400d6eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcec37fe640 1 -- 172.21.15.18:0/1202515526 learned_addr learned my addr 172.21.15.18:0/1202515526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.628+0000 7fcec8903640 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d6f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcec3fff640 1 -- 172.21.15.18:0/1202515526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 msgr2=0x55c400d6f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcec3fff640 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d6f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcec3fff640 1 -- 172.21.15.18:0/1202515526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d732e0 msgr2=0x55c400d840e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcec3fff640 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d732e0 0x55c400d840e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcec3fff640 1 -- 172.21.15.18:0/1202515526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c400d7c6e0 con 0x55c400d729a0 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcec3fff640 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d729a0 0x55c400d6eec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55c400d6ee90 tx=0x7fceb4032fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f242277b615766d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcea9ffb640 1 -- 172.21.15.18:0/1202515526 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4053070 con 0x55c400d729a0 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcea9ffb640 1 -- 172.21.15.18:0/1202515526 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fceb4031780 con 0x55c400d729a0 2024-09-19T08:47:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.629+0000 7fcea9ffb640 1 -- 172.21.15.18:0/1202515526 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4035040 con 0x55c400d729a0 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 -- 172.21.15.18:0/1202515526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d729a0 msgr2=0x55c400d6eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d729a0 0x55c400d6eec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55c400d6ee90 tx=0x7fceb4032fb0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 -- 172.21.15.18:0/1202515526 shutdown_connections 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d6f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d732e0 0x55c400d840e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 --2- 172.21.15.18:0/1202515526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d729a0 0x55c400d6eec0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 -- 172.21.15.18:0/1202515526 >> 172.21.15.18:0/1202515526 conn(0x55c400d6e010 msgr2=0x55c400d7cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 -- 172.21.15.18:0/1202515526 shutdown_connections 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 -- 172.21.15.18:0/1202515526 wait complete. 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.630+0000 7fcecd1de740 1 -- start start 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 Processor -- start 2024-09-19T08:47:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d81930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d81e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d82e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41ab620 con 0x55c400d729a0 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41aca90 con 0x55c400d732e0 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41abcf0 con 0x55c400d78370 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcecd1de740 10 client.0 _ll_register_callbacks cb 0x7fceb8009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d81e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d81930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d81e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:47596/0 (socket says 172.21.15.18:47596) 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.631+0000 7fcec37fe640 1 -- 172.21.15.18:0/4057209394 learned_addr learned my addr 172.21.15.18:0/4057209394 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec8903640 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d82e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec37fe640 1 -- 172.21.15.18:0/4057209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 msgr2=0x55c400d82e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec37fe640 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d82e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec37fe640 1 -- 172.21.15.18:0/4057209394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 msgr2=0x55c400d81930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec37fe640 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d81930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec37fe640 1 -- 172.21.15.18:0/4057209394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c400d73f70 con 0x55c400d732e0 2024-09-19T08:47:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcec37fe640 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d81e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fceb8098bf0 tx=0x7fceb800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f0cf129f94b310 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:47:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcea37fe640 1 -- 172.21.15.18:0/4057209394 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8098510 con 0x55c400d732e0 2024-09-19T08:47:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcea37fe640 1 -- 172.21.15.18:0/4057209394 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fceb8010430 con 0x55c400d732e0 2024-09-19T08:47:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb4031780 con 0x55c400d732e0 2024-09-19T08:47:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcea37fe640 1 -- 172.21.15.18:0/4057209394 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fceb809c040 con 0x55c400d732e0 2024-09-19T08:47:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcecd1de740 10 client.24971 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.632+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c400df34a0 con 0x55c400d732e0 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcea37fe640 1 -- 172.21.15.18:0/4057209394 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fceb4031780 con 0x55c400d732e0 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcea37fe640 1 -- 172.21.15.18:0/4057209394 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fceb8018ac0 con 0x55c400d732e0 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcecd1de740 10 client.24971 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcecd1de740 10 client.24971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcecd1de740 20 client.24971 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcecd1de740 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400df3c40 0x55c400df6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcecd1de740 4 client.24971 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c400cddd70 con 0x55c400df3c40 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcec3fff640 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400df3c40 0x55c400df6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcec3fff640 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400df3c40 0x55c400df6060 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9764289503ba60e7 server_cookie=e19e54d9bd338cef in_seq=0 out_seq=0 2024-09-19T08:47:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:27.633+0000 7fcea37fe640 10 client.24971 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:27.818 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] random.lo 2024-09-19T08:47:28.020 INFO:tasks.workunit.client.0.smithi018.stdout: [LD] 2024-09-19T08:47:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:27 smithi150 ceph-mon[34610]: pgmap v414: 129 pgs: 129 active+clean; 32 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 664 KiB/s wr, 526 op/s 2024-09-19T08:47:28.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:27 smithi162 ceph-mon[34870]: pgmap v414: 129 pgs: 129 active+clean; 32 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 664 KiB/s wr, 526 op/s 2024-09-19T08:47:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcea37fe640 1 -- 172.21.15.18:0/4057209394 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c400cddd70 con 0x55c400df3c40 2024-09-19T08:47:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcea37fe640 10 client.24971 handle_command_reply: tid=0 2024-09-19T08:47:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 client.24971 shutdown 2024-09-19T08:47:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 msgr2=0x55c400d81e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d81e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fceb8098bf0 tx=0x7fceb800c7d0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 shutdown_connections 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c400df3c40 0x55c400df6060 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c400d78370 0x55c400d82e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c400d732e0 0x55c400d81e70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 --2- 172.21.15.18:0/4057209394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c400d729a0 0x55c400d81930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 >> 172.21.15.18:0/4057209394 conn(0x55c400d6e010 msgr2=0x55c400d6c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.193+0000 7fcea37fe640 0 client.24971 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.194+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 shutdown_connections 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.194+0000 7fcecd1de740 1 -- 172.21.15.18:0/4057209394 wait complete. 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.194+0000 7fcecd1de740 20 client.24971 trim_cache size 0 max 16384 2024-09-19T08:47:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:47:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:47:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:47:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:47:28.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:27 smithi018 ceph-mon[30956]: pgmap v414: 129 pgs: 129 active+clean; 32 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 664 KiB/s wr, 526 op/s 2024-09-19T08:47:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fceac0a32f0 msgr2=0x7fceac0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fceac0a32f0 0x7fceac0a57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009fd0 tx=0x7fcebc004a40 comp rx=0 tx=0).stop 2024-09-19T08:47:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 msgr2=0x7fcec40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 0x7fcec40745e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9f0 tx=0x7fceb800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 shutdown_connections 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fceac0a32f0 0x7fceac0a57b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcec4103710 0x7fcec4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec4102d50 0x7fcec40745e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 --2- 172.21.15.18:0/15668011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec4101b60 0x7fcec4075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 >> 172.21.15.18:0/15668011 conn(0x7fcec40fd2e0 msgr2=0x7fcec4106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 shutdown_connections 2024-09-19T08:47:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:28.195+0000 7fceca366640 1 -- 172.21.15.18:0/15668011 wait complete. 2024-09-19T08:47:28.355 INFO:tasks.workunit.client.0.smithi018.stdout:Building ltp 2024-09-19T08:47:28.355 INFO:tasks.workunit.client.0.smithi018.stdout:Building src 2024-09-19T08:47:28.384 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-09-19T08:47:28.441 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-09-19T08:47:29.539 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] doio 2024-09-19T08:47:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:29 smithi150 ceph-mon[34610]: pgmap v415: 129 pgs: 129 active+clean; 33 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 656 KiB/s wr, 306 op/s 2024-09-19T08:47:30.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:29 smithi162 ceph-mon[34870]: pgmap v415: 129 pgs: 129 active+clean; 33 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 656 KiB/s wr, 306 op/s 2024-09-19T08:47:30.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:29 smithi018 ceph-mon[30956]: pgmap v415: 129 pgs: 129 active+clean; 33 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 656 KiB/s wr, 306 op/s 2024-09-19T08:47:30.571 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fsstress 2024-09-19T08:47:30.678 INFO:tasks.workunit.client.0.smithi018.stdout:Building m4 2024-09-19T08:47:30.703 INFO:tasks.workunit.client.0.smithi018.stdout:Building common 2024-09-19T08:47:30.727 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fsx 2024-09-19T08:47:31.884 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] growfiles 2024-09-19T08:47:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:31 smithi150 ceph-mon[34610]: pgmap v416: 129 pgs: 129 active+clean; 35 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.0 MiB/s wr, 207 op/s 2024-09-19T08:47:32.154 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] iogen 2024-09-19T08:47:32.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:31 smithi162 ceph-mon[34870]: pgmap v416: 129 pgs: 129 active+clean; 35 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.0 MiB/s wr, 207 op/s 2024-09-19T08:47:32.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:31 smithi018 ceph-mon[30956]: pgmap v416: 129 pgs: 129 active+clean; 35 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.0 MiB/s wr, 207 op/s 2024-09-19T08:47:32.716 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-stress 2024-09-19T08:47:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:33 smithi150 ceph-mon[34610]: pgmap v417: 129 pgs: 129 active+clean; 31 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.0 MiB/s wr, 147 op/s 2024-09-19T08:47:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:33 smithi162 ceph-mon[34870]: pgmap v417: 129 pgs: 129 active+clean; 31 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.0 MiB/s wr, 147 op/s 2024-09-19T08:47:34.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:33 smithi018 ceph-mon[30956]: pgmap v417: 129 pgs: 129 active+clean; 31 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.0 MiB/s wr, 147 op/s 2024-09-19T08:47:34.854 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-09-19T08:47:34.856 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-09-19T08:47:34.861 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-09-19T08:47:34.864 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-09-19T08:47:35.515 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dirstress 2024-09-19T08:47:35.516 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fill 2024-09-19T08:47:35.516 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fill2 2024-09-19T08:47:35.519 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] getpagesize 2024-09-19T08:47:35.770 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] holes 2024-09-19T08:47:35.807 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] lstat64 2024-09-19T08:47:35.930 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] nametest 2024-09-19T08:47:35.958 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] permname 2024-09-19T08:47:36.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:35 smithi150 ceph-mon[34610]: pgmap v418: 129 pgs: 129 active+clean; 31 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 896 KiB/s wr, 117 op/s 2024-09-19T08:47:36.125 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] randholes 2024-09-19T08:47:36.145 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] runas 2024-09-19T08:47:36.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:35 smithi162 ceph-mon[34870]: pgmap v418: 129 pgs: 129 active+clean; 31 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 896 KiB/s wr, 117 op/s 2024-09-19T08:47:36.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:35 smithi018 ceph-mon[30956]: pgmap v418: 129 pgs: 129 active+clean; 31 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 896 KiB/s wr, 117 op/s 2024-09-19T08:47:36.325 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] truncfile 2024-09-19T08:47:36.355 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] usemem 2024-09-19T08:47:36.476 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] mmapcat 2024-09-19T08:47:36.575 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] append_reader 2024-09-19T08:47:36.641 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] append_writer 2024-09-19T08:47:36.678 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dirperf 2024-09-19T08:47:36.757 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] metaperf 2024-09-19T08:47:36.872 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] devzero 2024-09-19T08:47:36.934 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] feature 2024-09-19T08:47:37.075 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] alloc 2024-09-19T08:47:37.201 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fault 2024-09-19T08:47:37.215 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fstest 2024-09-19T08:47:37.318 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_access_root 2024-09-19T08:47:37.469 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] godown 2024-09-19T08:47:37.527 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] resvtest 2024-09-19T08:47:37.607 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] writemod 2024-09-19T08:47:37.636 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] writev_on_pagefault 2024-09-19T08:47:37.809 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] makeextents 2024-09-19T08:47:37.878 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] itrash 2024-09-19T08:47:37.885 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] rename 2024-09-19T08:47:37.927 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] multi_open_unlink 2024-09-19T08:47:37.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:37 smithi018 ceph-mon[30956]: pgmap v419: 129 pgs: 129 active+clean; 32 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 965 KiB/s wr, 120 op/s 2024-09-19T08:47:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:37 smithi150 ceph-mon[34610]: pgmap v419: 129 pgs: 129 active+clean; 32 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 965 KiB/s wr, 120 op/s 2024-09-19T08:47:38.143 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] unwritten_sync 2024-09-19T08:47:38.166 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] genhashnames 2024-09-19T08:47:38.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:37 smithi162 ceph-mon[34870]: pgmap v419: 129 pgs: 129 active+clean; 32 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 965 KiB/s wr, 120 op/s 2024-09-19T08:47:38.167 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_holes 2024-09-19T08:47:38.231 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_writev 2024-09-19T08:47:38.445 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_truncate_cmtime 2024-09-19T08:47:38.491 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dirhash_collide 2024-09-19T08:47:38.507 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_rename_overwrite 2024-09-19T08:47:38.510 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] holetest 2024-09-19T08:47:38.725 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_truncate_self 2024-09-19T08:47:38.767 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] af_unix 2024-09-19T08:47:38.868 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_stale_pmd 2024-09-19T08:47:38.903 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_cow_race 2024-09-19T08:47:38.973 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_fallocate 2024-09-19T08:47:39.060 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fsync-err 2024-09-19T08:47:39.171 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_write_ro 2024-09-19T08:47:39.232 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-19T08:47:39.273 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-19T08:47:39.430 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_ofd_locks 2024-09-19T08:47:39.483 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_collision 2024-09-19T08:47:39.551 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] mmap-write-concurrent 2024-09-19T08:47:39.599 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_get_file_time 2024-09-19T08:47:39.820 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_create_short_dirs 2024-09-19T08:47:39.877 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_create_long_dirs 2024-09-19T08:47:39.884 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_enospc 2024-09-19T08:47:39.904 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_writev_overlap 2024-09-19T08:47:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:39 smithi150 ceph-mon[34610]: pgmap v420: 129 pgs: 129 active+clean; 34 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 918 KiB/s wr, 70 op/s 2024-09-19T08:47:40.152 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] checkpoint_journal 2024-09-19T08:47:40.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:39 smithi162 ceph-mon[34870]: pgmap v420: 129 pgs: 129 active+clean; 34 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 918 KiB/s wr, 70 op/s 2024-09-19T08:47:40.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:39 smithi018 ceph-mon[30956]: pgmap v420: 129 pgs: 129 active+clean; 34 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 918 KiB/s wr, 70 op/s 2024-09-19T08:47:40.205 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] mmap-rw-fault 2024-09-19T08:47:40.246 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] allocstale 2024-09-19T08:47:40.256 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_cow_memory_failure 2024-09-19T08:47:40.470 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fake-dump-rootino 2024-09-19T08:47:40.574 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dio-buf-fault 2024-09-19T08:47:40.596 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] rewinddir-test 2024-09-19T08:47:40.607 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] readdir-while-renames 2024-09-19T08:47:40.769 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] xfsctl 2024-09-19T08:47:40.881 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] bstat 2024-09-19T08:47:40.935 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mtab 2024-09-19T08:47:40.938 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] getdevicesize 2024-09-19T08:47:41.197 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] preallo_rw_pattern_reader 2024-09-19T08:47:41.266 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] preallo_rw_pattern_writer 2024-09-19T08:47:41.284 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] ftrunc 2024-09-19T08:47:41.285 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] trunc 2024-09-19T08:47:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.319+0000 7f341c70a640 1 -- 172.21.15.18:0/595200114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34141001d0 msgr2=0x7f34141005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.319+0000 7f341c70a640 1 --2- 172.21.15.18:0/595200114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34141001d0 0x7f34141005d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f341000aa10 tx=0x7f341002b720 comp rx=0 tx=0).stop 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 -- 172.21.15.18:0/595200114 shutdown_connections 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 --2- 172.21.15.18:0/595200114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3414101d80 0x7f3414108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 --2- 172.21.15.18:0/595200114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141013c0 0x7f3414101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 --2- 172.21.15.18:0/595200114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34141001d0 0x7f34141005d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 -- 172.21.15.18:0/595200114 >> 172.21.15.18:0/595200114 conn(0x7f34140fb930 msgr2=0x7f34140fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 -- 172.21.15.18:0/595200114 shutdown_connections 2024-09-19T08:47:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.320+0000 7f341c70a640 1 -- 172.21.15.18:0/595200114 wait complete. 2024-09-19T08:47:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 Processor -- start 2024-09-19T08:47:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 -- start start 2024-09-19T08:47:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141001d0 0x7f3414197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34141013c0 0x7f3414198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 0x7f341419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f341410b4c0 con 0x7f3414101d80 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f341410b340 con 0x7f34141013c0 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341c70a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f341410b640 con 0x7f34141001d0 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341aca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 0x7f341419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341aca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 0x7f341419f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52362/0 (socket says 172.21.15.18:52362) 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341aca7640 1 -- 172.21.15.18:0/1283834370 learned_addr learned my addr 172.21.15.18:0/1283834370 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f341a4a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141001d0 0x7f3414197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.321+0000 7f3419ca5640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34141013c0 0x7f3414198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341a4a6640 1 -- 172.21.15.18:0/1283834370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34141013c0 msgr2=0x7f3414198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341a4a6640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34141013c0 0x7f3414198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341a4a6640 1 -- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 msgr2=0x7f341419f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341a4a6640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 0x7f341419f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341a4a6640 1 -- 172.21.15.18:0/1283834370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341419f930 con 0x7f34141001d0 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341aca7640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 0x7f341419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341a4a6640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141001d0 0x7f3414197d20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f341000a340 tx=0x7f3410030d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f340b7fe640 1 -- 172.21.15.18:0/1283834370 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341003f070 con 0x7f34141001d0 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341419fbc0 con 0x7f34141001d0 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f340b7fe640 1 -- 172.21.15.18:0/1283834370 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3410032400 con 0x7f34141001d0 2024-09-19T08:47:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f340b7fe640 1 -- 172.21.15.18:0/1283834370 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410036040 con 0x7f34141001d0 2024-09-19T08:47:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.322+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3414195710 con 0x7f34141001d0 2024-09-19T08:47:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.326+0000 7f341f4a1740 1 Processor -- start 2024-09-19T08:47:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.326+0000 7f341f4a1740 1 -- start start 2024-09-19T08:47:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.326+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 0x55e49db52da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.326+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db57da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.326+0000 7f340b7fe640 1 -- 172.21.15.18:0/1283834370 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3410042070 con 0x7f34141001d0 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db58370 0x55e49db5a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341f4a1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e49dab62f0 con 0x55e49db58370 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341f4a1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e49da5e270 con 0x55e49db532e0 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341f4a1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e49dab22b0 con 0x55e49db529a0 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 0x55e49db52da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 0x55e49db52da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49594/0 (socket says 172.21.15.18:49594) 2024-09-19T08:47:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 -- 172.21.15.18:0/3987044396 learned_addr learned my addr 172.21.15.18:0/3987044396 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f3419ca5640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db58370 0x55e49db5a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 -- 172.21.15.18:0/3987044396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 msgr2=0x55e49db57da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341a4a6640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db57da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db57da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 -- 172.21.15.18:0/3987044396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db58370 msgr2=0x55e49db5a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db58370 0x55e49db5a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341aca7640 1 -- 172.21.15.18:0/3987044396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e49da5d340 con 0x55e49db529a0 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f3419ca5640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db58370 0x55e49db5a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.327+0000 7f341a4a6640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db57da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:47:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f341aca7640 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 0x55e49db52da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f340c0117e0 tx=0x7f340c011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c80ec3f765e9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f340b7fe640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34000a7780 0x7f34000a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f3408ff9640 1 -- 172.21.15.18:0/3987044396 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c00fb40 con 0x55e49db529a0 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f3408ff9640 1 -- 172.21.15.18:0/3987044396 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f340c00fce0 con 0x55e49db529a0 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f3408ff9640 1 -- 172.21.15.18:0/3987044396 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c010630 con 0x55e49db529a0 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f341a4a6640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34000a7780 0x7f34000a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.328+0000 7f340b7fe640 1 -- 172.21.15.18:0/1283834370 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f34100f0420 con 0x7f34141001d0 2024-09-19T08:47:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 -- 172.21.15.18:0/3987044396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 msgr2=0x55e49db52da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341a4a6640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34000a7780 0x7f34000a9c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3410000c00 tx=0x7f341002b720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 0x55e49db52da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f340c0117e0 tx=0x7f340c011ca0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 -- 172.21.15.18:0/3987044396 shutdown_connections 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db58370 0x55e49db5a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db57da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 --2- 172.21.15.18:0/3987044396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db529a0 0x55e49db52da0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 -- 172.21.15.18:0/3987044396 >> 172.21.15.18:0/3987044396 conn(0x55e49db4e010 msgr2=0x55e49db4e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 -- 172.21.15.18:0/3987044396 shutdown_connections 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.329+0000 7f341f4a1740 1 -- 172.21.15.18:0/3987044396 wait complete. 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 -- start start 2024-09-19T08:47:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 Processor -- start 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db529a0 0x55e49db5cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 0x55e49db5d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e49db5b340 con 0x55e49db532e0 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e49da3f290 con 0x55e49db529a0 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e49db5b4c0 con 0x55e49db58370 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.330+0000 7f341f4a1740 10 client.0 _ll_register_callbacks cb 0x55e49da70140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 0x55e49db5d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 0x55e49db5d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52386/0 (socket says 172.21.15.18:52386) 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 -- 172.21.15.18:0/239233581 learned_addr learned my addr 172.21.15.18:0/239233581 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f341aca7640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db529a0 0x55e49db5cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f341aca7640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 -- 172.21.15.18:0/239233581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 msgr2=0x55e49db641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 -- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db529a0 msgr2=0x55e49db5cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db529a0 0x55e49db5cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 -- 172.21.15.18:0/239233581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e49d7c9210 con 0x55e49db532e0 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f341aca7640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db529a0 0x55e49db5cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f3419ca5640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 0x55e49db5d190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f340400baa0 tx=0x7f340400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9eb859b43ac9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.331+0000 7f33fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:47:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.332+0000 7f33fdffb640 1 -- 172.21.15.18:0/239233581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340401b640 con 0x55e49db532e0 2024-09-19T08:47:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.332+0000 7f33fdffb640 1 -- 172.21.15.18:0/239233581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f340401b7e0 con 0x55e49db532e0 2024-09-19T08:47:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.332+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f340c00fce0 con 0x55e49db532e0 2024-09-19T08:47:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.332+0000 7f33fdffb640 1 -- 172.21.15.18:0/239233581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f340401b9e0 con 0x55e49db532e0 2024-09-19T08:47:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.332+0000 7f341f4a1740 10 client.15342 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.332+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e49d895620 con 0x55e49db532e0 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f33fdffb640 1 -- 172.21.15.18:0/239233581 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f340c00fce0 con 0x55e49db532e0 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f33fdffb640 1 -- 172.21.15.18:0/239233581 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3404019020 con 0x55e49db532e0 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f341f4a1740 10 client.15342 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f341f4a1740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f341f4a1740 20 client.15342 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f341f4a1740 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49db68890 0x55e49db6ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f341f4a1740 4 client.15342 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.333+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e49dac3a20 con 0x55e49db68890 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.334+0000 7f341aca7640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49db68890 0x55e49db6ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.334+0000 7f341aca7640 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49db68890 0x55e49db6ac80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4218fd79e5296ef server_cookie=161f45b765b765e3 in_seq=0 out_seq=0 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.334+0000 7f33fdffb640 10 client.15342 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.335+0000 7f33fdffb640 1 -- 172.21.15.18:0/239233581 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e49dac3a20 con 0x55e49db68890 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.335+0000 7f33fdffb640 10 client.15342 handle_command_reply: tid=0 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.335+0000 7f341f4a1740 1 client.15342 shutdown 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 msgr2=0x55e49db5d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 0x55e49db5d190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f340400baa0 tx=0x7f340400bf60 comp rx=0 tx=0).stop 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 shutdown_connections 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49db68890 0x55e49db6ac80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db532e0 0x55e49db5d190 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f33fdffb640 0 client.15342 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 --2- 172.21.15.18:0/239233581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db529a0 0x55e49db5cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 >> 172.21.15.18:0/239233581 conn(0x55e49db4e010 msgr2=0x55e49db4f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 shutdown_connections 2024-09-19T08:47:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 1 -- 172.21.15.18:0/239233581 wait complete. 2024-09-19T08:47:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.336+0000 7f341f4a1740 20 client.15342 trim_cache size 0 max 16384 2024-09-19T08:47:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 Processor -- start 2024-09-19T08:47:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 -- start start 2024-09-19T08:47:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db4d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db532e0 0x55e49db64190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db58370 0x55e49db4f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34141a6570 con 0x55e49db529a0 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34141a8df0 con 0x55e49db58370 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341f4a1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34141a6be0 con 0x55e49db532e0 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.355+0000 7f341aca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db4d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db4d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52392/0 (socket says 172.21.15.18:52392) 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 -- 172.21.15.18:0/1111848163 learned_addr learned my addr 172.21.15.18:0/1111848163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f3419ca5640 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db532e0 0x55e49db64190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db58370 0x55e49db4f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 -- 172.21.15.18:0/1111848163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db532e0 msgr2=0x55e49db64190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db532e0 0x55e49db64190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 -- 172.21.15.18:0/1111848163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db58370 msgr2=0x55e49db4f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db58370 0x55e49db4f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 -- 172.21.15.18:0/1111848163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e49db492d0 con 0x55e49db529a0 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f341aca7640 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db4d0b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f340c012010 tx=0x7f340c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc259e94e44fba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f33fffff640 1 -- 172.21.15.18:0/1111848163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c025040 con 0x55e49db529a0 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f33fffff640 1 -- 172.21.15.18:0/1111848163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f340c031070 con 0x55e49db529a0 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.356+0000 7f33fffff640 1 -- 172.21.15.18:0/1111848163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c012a80 con 0x55e49db529a0 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 -- 172.21.15.18:0/1111848163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 msgr2=0x55e49db4d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db4d0b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f340c012010 tx=0x7f340c005bd0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 -- 172.21.15.18:0/1111848163 shutdown_connections 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db58370 0x55e49db4f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db532e0 0x55e49db64190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1111848163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db4d0b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 -- 172.21.15.18:0/1111848163 >> 172.21.15.18:0/1111848163 conn(0x55e49db4e010 msgr2=0x55e49db4c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 -- 172.21.15.18:0/1111848163 shutdown_connections 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.357+0000 7f341f4a1740 1 -- 172.21.15.18:0/1111848163 wait complete. 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 -- start start 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 Processor -- start 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db61620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db61b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db62b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34141a72b0 con 0x55e49db529a0 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34141a8720 con 0x55e49db532e0 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34141a7980 con 0x55e49db58370 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341f4a1740 10 client.0 _ll_register_callbacks cb 0x7f3404004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341aca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db61620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341aca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db61620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52394/0 (socket says 172.21.15.18:52394) 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341aca7640 1 -- 172.21.15.18:0/1985048378 learned_addr learned my addr 172.21.15.18:0/1985048378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f3419ca5640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db61b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.358+0000 7f341aca7640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db62b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341aca7640 1 -- 172.21.15.18:0/1985048378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 msgr2=0x55e49db62b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341aca7640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db62b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341aca7640 1 -- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 msgr2=0x55e49db61b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341aca7640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db61b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341aca7640 1 -- 172.21.15.18:0/1985048378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e49db63180 con 0x55e49db529a0 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341aca7640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db61620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f340c005cc0 tx=0x7f340c011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc674a94d1089c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f33fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f33fdffb640 1 -- 172.21.15.18:0/1985048378 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c012a00 con 0x55e49db529a0 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f33fdffb640 1 -- 172.21.15.18:0/1985048378 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f340c012ba0 con 0x55e49db529a0 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f340c031070 con 0x55e49db529a0 2024-09-19T08:47:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f33fdffb640 1 -- 172.21.15.18:0/1985048378 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f340c004a00 con 0x55e49db529a0 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341f4a1740 10 client.15348 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.359+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e49db64490 con 0x55e49db529a0 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f33fdffb640 1 -- 172.21.15.18:0/1985048378 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f340c004ba0 con 0x55e49db529a0 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f33fdffb640 1 -- 172.21.15.18:0/1985048378 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f340c00c070 con 0x55e49db529a0 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f341f4a1740 10 client.15348 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f341f4a1740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f341f4a1740 20 client.15348 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49dbd39d0 0x55e49dbd5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f341f4a1740 4 client.15348 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f340c031070 con 0x55e49dbd39d0 2024-09-19T08:47:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.360+0000 7f3419ca5640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49dbd39d0 0x55e49dbd5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.361+0000 7f3419ca5640 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49dbd39d0 0x55e49dbd5df0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc1eab58b2b254d server_cookie=9ab92424f705cbf2 in_seq=0 out_seq=0 2024-09-19T08:47:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:41.361+0000 7f33fdffb640 10 client.15348 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:41.524 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fs_perms 2024-09-19T08:47:41.584 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] testx 2024-09-19T08:47:41.592 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] looptest 2024-09-19T08:47:41.611 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] locktest 2024-09-19T08:47:41.832 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] unwritten_mmap 2024-09-19T08:47:41.833 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] bulkstat_unlink_test 2024-09-19T08:47:41.930 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] deduperace 2024-09-19T08:47:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:41 smithi150 ceph-mon[34610]: pgmap v421: 129 pgs: 129 active+clean; 34 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 911 KiB/s wr, 78 op/s 2024-09-19T08:47:42.121 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] bulkstat_unlink_test_modified 2024-09-19T08:47:42.136 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_dir_offset 2024-09-19T08:47:42.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:41 smithi162 ceph-mon[34870]: pgmap v421: 129 pgs: 129 active+clean; 34 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 911 KiB/s wr, 78 op/s 2024-09-19T08:47:42.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:41 smithi018 ceph-mon[30956]: pgmap v421: 129 pgs: 129 active+clean; 34 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 911 KiB/s wr, 78 op/s 2024-09-19T08:47:42.199 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_futimens 2024-09-19T08:47:42.284 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_immutable 2024-09-19T08:47:42.415 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] stale_handle 2024-09-19T08:47:42.454 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] pwrite_mmap_blocked 2024-09-19T08:47:42.491 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_dir_offset2 2024-09-19T08:47:42.737 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] seek_sanity_test 2024-09-19T08:47:42.739 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] seek_copy_test 2024-09-19T08:47:42.830 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_readdir_1 2024-09-19T08:47:43.088 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_readdir_2 2024-09-19T08:47:43.088 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fsync-tester 2024-09-19T08:47:43.234 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] nsexec 2024-09-19T08:47:43.359 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] cloner 2024-09-19T08:47:43.434 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] renameat2 2024-09-19T08:47:43.514 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_getcwd 2024-09-19T08:47:43.554 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] e4compact 2024-09-19T08:47:43.723 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] test-nextquota 2024-09-19T08:47:43.807 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] punch-alternating 2024-09-19T08:47:43.831 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-19T08:47:43.921 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] listxattr 2024-09-19T08:47:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:43 smithi150 ceph-mon[34610]: pgmap v422: 129 pgs: 129 active+clean; 35 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 469 KiB/s wr, 89 op/s 2024-09-19T08:47:44.089 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dio-interleaved 2024-09-19T08:47:44.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:43 smithi162 ceph-mon[34870]: pgmap v422: 129 pgs: 129 active+clean; 35 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 469 KiB/s wr, 89 op/s 2024-09-19T08:47:44.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:43 smithi018 ceph-mon[30956]: pgmap v422: 129 pgs: 129 active+clean; 35 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 469 KiB/s wr, 89 op/s 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f33fdffb640 1 -- 172.21.15.18:0/1985048378 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f340c031070 con 0x55e49dbd39d0 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f33fdffb640 10 client.15348 handle_command_reply: tid=0 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 client.15348 shutdown 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 msgr2=0x55e49db61620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db61620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f340c005cc0 tx=0x7f340c011560 comp rx=0 tx=0).stop 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 shutdown_connections 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55e49dbd39d0 0x55e49dbd5df0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e49db58370 0x55e49db62b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e49db532e0 0x55e49db61b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 --2- 172.21.15.18:0/1985048378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e49db529a0 0x55e49db61620 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 >> 172.21.15.18:0/1985048378 conn(0x55e49db4e010 msgr2=0x55e49db4d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f33fdffb640 0 client.15348 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 shutdown_connections 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 1 -- 172.21.15.18:0/1985048378 wait complete. 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.358+0000 7f341f4a1740 20 client.15348 trim_cache size 0 max 16384 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:47:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:47:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:47:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34000a7780 msgr2=0x7f34000a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34000a7780 0x7f34000a9c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3410000c00 tx=0x7f341002b720 comp rx=0 tx=0).stop 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141001d0 msgr2=0x7f3414197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141001d0 0x7f3414197d20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f341000a340 tx=0x7f3410030d20 comp rx=0 tx=0).stop 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 shutdown_connections 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f34000a7780 0x7f34000a9c40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414101d80 0x7f341419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34141013c0 0x7f3414198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 --2- 172.21.15.18:0/1283834370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34141001d0 0x7f3414197d20 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f341000a340 tx=0x7f3410030d20 comp rx=0 tx=0).stop 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 >> 172.21.15.18:0/1283834370 conn(0x7f34140fb930 msgr2=0x7f3414104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 shutdown_connections 2024-09-19T08:47:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:44.359+0000 7f341c70a640 1 -- 172.21.15.18:0/1283834370 wait complete. 2024-09-19T08:47:44.383 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_dir_type 2024-09-19T08:47:44.391 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dio-invalidate-cache 2024-09-19T08:47:44.392 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] stat_test 2024-09-19T08:47:44.440 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_encrypted_d_revalidate 2024-09-19T08:47:44.748 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] attr_replace_test 2024-09-19T08:47:44.789 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] swapon 2024-09-19T08:47:44.791 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] mkswap 2024-09-19T08:47:44.964 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_attr_corruption 2024-09-19T08:47:45.122 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_open_tmpfiles 2024-09-19T08:47:45.122 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fscrypt-crypt-util 2024-09-19T08:47:45.209 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] bulkstat_null_ocount 2024-09-19T08:47:45.253 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] splice-test 2024-09-19T08:47:45.533 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] chprojid_fail 2024-09-19T08:47:45.535 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] detached_mounts_propagation 2024-09-19T08:47:45.678 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] ext4_resize 2024-09-19T08:47:45.875 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_readdir_3 2024-09-19T08:47:45.883 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] splice2pipe 2024-09-19T08:47:46.001 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] uuid_ioctl 2024-09-19T08:47:46.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:45 smithi150 ceph-mon[34610]: pgmap v423: 129 pgs: 129 active+clean; 35 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 413 KiB/s wr, 69 op/s 2024-09-19T08:47:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:45 smithi162 ceph-mon[34870]: pgmap v423: 129 pgs: 129 active+clean; 35 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 413 KiB/s wr, 69 op/s 2024-09-19T08:47:46.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:45 smithi018 ceph-mon[30956]: pgmap v423: 129 pgs: 129 active+clean; 35 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 413 KiB/s wr, 69 op/s 2024-09-19T08:47:46.209 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-19T08:47:46.217 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fiemap-fault 2024-09-19T08:47:46.265 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fiemap-tester 2024-09-19T08:47:46.439 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_stripealign 2024-09-19T08:47:46.567 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] open_by_handle 2024-09-19T08:47:46.620 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_mmap_dio 2024-09-19T08:47:46.721 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] xfsfind 2024-09-19T08:47:46.762 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_reflink_read_race 2024-09-19T08:47:46.950 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fssum 2024-09-19T08:47:47.037 INFO:tasks.workunit.client.0.smithi018.stdout:Building log-writes 2024-09-19T08:47:47.066 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] replay-log 2024-09-19T08:47:47.170 INFO:tasks.workunit.client.0.smithi018.stdout:Building perf 2024-09-19T08:47:47.172 INFO:tasks.workunit.client.0.smithi018.stdout:Building aio-dio-regress 2024-09-19T08:47:47.192 INFO:tasks.workunit.client.0.smithi018.stdout:Building vfs 2024-09-19T08:47:47.218 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aiocp 2024-09-19T08:47:47.234 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] vfstest 2024-09-19T08:47:47.573 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-19T08:47:47.711 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] mount-idmapped 2024-09-19T08:47:47.740 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-append-write-read-race 2024-09-19T08:47:47.971 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-cow-race 2024-09-19T08:47:48.007 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-cycle-write 2024-09-19T08:47:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:47 smithi150 ceph-mon[34610]: pgmap v424: 129 pgs: 129 active+clean; 33 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 505 KiB/s wr, 126 op/s 2024-09-19T08:47:48.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:47 smithi162 ceph-mon[34870]: pgmap v424: 129 pgs: 129 active+clean; 33 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 505 KiB/s wr, 126 op/s 2024-09-19T08:47:48.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:47 smithi018 ceph-mon[30956]: pgmap v424: 129 pgs: 129 active+clean; 33 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 505 KiB/s wr, 126 op/s 2024-09-19T08:47:48.572 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-eof-race 2024-09-19T08:47:48.572 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-extend-stat 2024-09-19T08:47:48.847 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-fcntl-race 2024-09-19T08:47:48.856 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-hole-filling-race 2024-09-19T08:47:49.089 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-invalidate-failure 2024-09-19T08:47:49.149 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-invalidate-readahead 2024-09-19T08:47:49.159 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aiodio_sparse2 2024-09-19T08:47:49.368 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-subblock-eof-read 2024-09-19T08:47:49.468 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-dio-write-verify 2024-09-19T08:47:49.502 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-19T08:47:49.612 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-19T08:47:49.737 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] aio-last-ref-held-by-io 2024-09-19T08:47:50.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:49 smithi150 ceph-mon[34610]: pgmap v425: 129 pgs: 129 active+clean; 33 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 488 KiB/s wr, 145 op/s 2024-09-19T08:47:50.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:49 smithi018 ceph-mon[30956]: pgmap v425: 129 pgs: 129 active+clean; 33 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 488 KiB/s wr, 145 op/s 2024-09-19T08:47:50.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:49 smithi162 ceph-mon[34870]: pgmap v425: 129 pgs: 129 active+clean; 33 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 488 KiB/s wr, 145 op/s 2024-09-19T08:47:50.428 INFO:tasks.workunit.client.0.smithi018.stderr:+ cd .. 2024-09-19T08:47:50.429 INFO:tasks.workunit.client.0.smithi018.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-19T08:47:50.435 INFO:tasks.workunit.client.0.smithi018.stderr:+ OPTIONS=-z 2024-09-19T08:47:50.435 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-19T08:47:50.436 INFO:tasks.workunit.client.0.smithi018.stdout:Seed set to 1 2024-09-19T08:47:50.482 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T08:47:50.482 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T08:47:50.482 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T08:47:50.482 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T08:47:50.489 INFO:tasks.workunit.client.0.smithi018.stdout:skipping zero size read 2024-09-19T08:47:50.489 INFO:tasks.workunit.client.0.smithi018.stdout:skipping zero size read 2024-09-19T08:47:50.489 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0x9abd6 2024-09-19T08:47:50.535 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0xaeaec 2024-09-19T08:47:50.570 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0xf3194 2024-09-19T08:47:50.614 INFO:tasks.workunit.client.0.smithi018.stdout:copying to largest ever: 0xf3ceb 2024-09-19T08:47:50.789 INFO:tasks.workunit.client.0.smithi018.stdout:copying to largest ever: 0xfaccc 2024-09-19T08:47:50.796 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0xfbb6d 2024-09-19T08:47:51.217 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0xffee7 2024-09-19T08:47:52.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:51 smithi150 ceph-mon[34610]: pgmap v426: 129 pgs: 129 active+clean; 34 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 369 KiB/s wr, 170 op/s 2024-09-19T08:47:52.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:51 smithi162 ceph-mon[34870]: pgmap v426: 129 pgs: 129 active+clean; 34 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 369 KiB/s wr, 170 op/s 2024-09-19T08:47:52.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:51 smithi018 ceph-mon[30956]: pgmap v426: 129 pgs: 129 active+clean; 34 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 369 KiB/s wr, 170 op/s 2024-09-19T08:47:53.989 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0x100000 2024-09-19T08:47:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:53 smithi150 ceph-mon[34610]: pgmap v427: 129 pgs: 129 active+clean; 35 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 440 KiB/s wr, 184 op/s 2024-09-19T08:47:54.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:53 smithi162 ceph-mon[34870]: pgmap v427: 129 pgs: 129 active+clean; 35 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 440 KiB/s wr, 184 op/s 2024-09-19T08:47:54.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:53 smithi018 ceph-mon[30956]: pgmap v427: 129 pgs: 129 active+clean; 35 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 440 KiB/s wr, 184 op/s 2024-09-19T08:47:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:55 smithi150 ceph-mon[34610]: pgmap v428: 129 pgs: 129 active+clean; 35 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 346 KiB/s wr, 152 op/s 2024-09-19T08:47:56.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:55 smithi162 ceph-mon[34870]: pgmap v428: 129 pgs: 129 active+clean; 35 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 346 KiB/s wr, 152 op/s 2024-09-19T08:47:56.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:55 smithi018 ceph-mon[30956]: pgmap v428: 129 pgs: 129 active+clean; 35 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 346 KiB/s wr, 152 op/s 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 -- 172.21.15.18:0/1467968011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954101c30 msgr2=0x7f29541020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1467968011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954101c30 0x7f29541020b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2940009900 tx=0x7f294002a410 comp rx=0 tx=0).stop 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 -- 172.21.15.18:0/1467968011 shutdown_connections 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1467968011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29541025f0 0x7f2954108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1467968011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954101c30 0x7f29541020b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1467968011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2954100a40 0x7f2954100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 -- 172.21.15.18:0/1467968011 >> 172.21.15.18:0/1467968011 conn(0x7f29540fc1e0 msgr2=0x7f29540fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 -- 172.21.15.18:0/1467968011 shutdown_connections 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.463+0000 7f295ae3c640 1 -- 172.21.15.18:0/1467968011 wait complete. 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 Processor -- start 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 -- start start 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954100a40 0x7f2954197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 0x7f2954198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541025f0 0x7f295419f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f295410d6d0 con 0x7f2954101c30 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f295410d550 con 0x7f29541025f0 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f295ae3c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f295410d850 con 0x7f2954100a40 2024-09-19T08:47:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f2953fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 0x7f2954198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f29593d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541025f0 0x7f295419f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f2953fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 0x7f2954198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59766/0 (socket says 172.21.15.18:59766) 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f2953fff640 1 -- 172.21.15.18:0/1410555565 learned_addr learned my addr 172.21.15.18:0/1410555565 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.464+0000 7f2958bd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954100a40 0x7f2954197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2953fff640 1 -- 172.21.15.18:0/1410555565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954100a40 msgr2=0x7f2954197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2953fff640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954100a40 0x7f2954197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2953fff640 1 -- 172.21.15.18:0/1410555565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541025f0 msgr2=0x7f295419f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2953fff640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541025f0 0x7f295419f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2953fff640 1 -- 172.21.15.18:0/1410555565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295419f950 con 0x7f2954101c30 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f29593d9640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541025f0 0x7f295419f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2953fff640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 0x7f2954198280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2940005940 tx=0x7f29400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2951ffb640 1 -- 172.21.15.18:0/1410555565 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294003f030 con 0x7f2954101c30 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295419fbe0 con 0x7f2954101c30 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2951ffb640 1 -- 172.21.15.18:0/1410555565 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29400318f0 con 0x7f2954101c30 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f2951ffb640 1 -- 172.21.15.18:0/1410555565 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940035070 con 0x7f2954101c30 2024-09-19T08:47:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.465+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29541a00d0 con 0x7f2954101c30 2024-09-19T08:47:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f2951ffb640 1 -- 172.21.15.18:0/1410555565 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2940042030 con 0x7f2954101c30 2024-09-19T08:47:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 Processor -- start 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 -- start start 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedf9bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfa3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562fedeff2f0 con 0x562fedf9c2e0 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x562fedea7270 con 0x562fedf9b9a0 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f295dbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562fedefb2b0 con 0x562fedfa1370 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f2958bd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.468+0000 7f2953fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfa3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59768/0 (socket says 172.21.15.18:59768) 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 -- 172.21.15.18:0/1145596947 learned_addr learned my addr 172.21.15.18:0/1145596947 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2953fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfa3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41694/0 (socket says 172.21.15.18:41694) 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f29593d9640 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedf9bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2951ffb640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29440a32f0 0x7f29440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 -- 172.21.15.18:0/1145596947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 msgr2=0x562fedfa3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfa3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 -- 172.21.15.18:0/1145596947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 msgr2=0x562fedf9bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedf9bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 -- 172.21.15.18:0/1145596947 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fedea6340 con 0x562fedf9c2e0 2024-09-19T08:47:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f29593d9640 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedf9bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f29593d9640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29440a32f0 0x7f29440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2951ffb640 1 -- 172.21.15.18:0/1410555565 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f29400f0540 con 0x7f2954101c30 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f2958bd8640 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa0da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2948009c60 tx=0x7f2948011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67da27a1a758cbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f293effd640 1 -- 172.21.15.18:0/1145596947 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948004220 con 0x562fedf9c2e0 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f293effd640 1 -- 172.21.15.18:0/1145596947 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29480043c0 con 0x562fedf9c2e0 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.469+0000 7f293effd640 1 -- 172.21.15.18:0/1145596947 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948019830 con 0x562fedf9c2e0 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 -- 172.21.15.18:0/1145596947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 msgr2=0x562fedfa0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f29593d9640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29440a32f0 0x7f29440a57b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f294c005fd0 tx=0x7f294c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa0da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2948009c60 tx=0x7f2948011810 comp rx=0 tx=0).stop 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 -- 172.21.15.18:0/1145596947 shutdown_connections 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfa3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa0da0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 --2- 172.21.15.18:0/1145596947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedf9bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 -- 172.21.15.18:0/1145596947 >> 172.21.15.18:0/1145596947 conn(0x562fedf97010 msgr2=0x562fedf97410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 -- 172.21.15.18:0/1145596947 shutdown_connections 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.470+0000 7f295dbd5740 1 -- 172.21.15.18:0/1145596947 wait complete. 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 -- start start 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 Processor -- start 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedfa5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562fedfa4340 con 0x562fedf9c2e0 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x562fede88290 con 0x562fedf9b9a0 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562fedfa44c0 con 0x562fedfa1370 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f295dbd5740 10 client.0 _ll_register_callbacks cb 0x562fedeb9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f2953fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f29593d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f2953fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59778/0 (socket says 172.21.15.18:59778) 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.471+0000 7f2953fff640 1 -- 172.21.15.18:0/3542267158 learned_addr learned my addr 172.21.15.18:0/3542267158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2958bd8640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedfa5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2953fff640 1 -- 172.21.15.18:0/3542267158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 msgr2=0x562fedfad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2953fff640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2953fff640 1 -- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 msgr2=0x562fedfa5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2953fff640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedfa5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2953fff640 1 -- 172.21.15.18:0/3542267158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fedc12210 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2958bd8640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedfa5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2953fff640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa60e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29400314e0 tx=0x7f29400f3c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35481e604e64e359 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2933fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2933fff640 1 -- 172.21.15.18:0/3542267158 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940049040 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f2933fff640 1 -- 172.21.15.18:0/3542267158 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f29400f0230 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.472+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29480043c0 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f2933fff640 1 -- 172.21.15.18:0/3542267158 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f29400bc560 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 10 client.15360 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562fedcde620 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f2933fff640 1 -- 172.21.15.18:0/3542267158 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29400bce90 con 0x562fedf9c2e0 2024-09-19T08:47:57.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f2933fff640 1 -- 172.21.15.18:0/3542267158 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2940003800 con 0x562fedf9c2e0 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 10 client.15360 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 20 client.15360 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fedfb1720 0x562fedfb3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 4 client.15360 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f29480043c0 con 0x562fedfb1720 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.473+0000 7f2958bd8640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fedfb1720 0x562fedfb3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.474+0000 7f2958bd8640 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fedfb1720 0x562fedfb3b30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf426ddbc76e26f8 server_cookie=c9173d0e04f92ece in_seq=0 out_seq=0 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.474+0000 7f2933fff640 10 client.15360 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.474+0000 7f2933fff640 1 -- 172.21.15.18:0/3542267158 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f29480043c0 con 0x562fedfb1720 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.474+0000 7f2933fff640 10 client.15360 handle_command_reply: tid=0 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.474+0000 7f295dbd5740 1 client.15360 shutdown 2024-09-19T08:47:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 msgr2=0x562fedfa60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa60e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29400314e0 tx=0x7f29400f3c10 comp rx=0 tx=0).stop 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 shutdown_connections 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fedfb1720 0x562fedfb3b30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedfa1370 0x562fedfad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfa60e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f2933fff640 0 client.15360 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 --2- 172.21.15.18:0/3542267158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9b9a0 0x562fedfa5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 >> 172.21.15.18:0/3542267158 conn(0x562fedf97010 msgr2=0x562fedf98820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 shutdown_connections 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 1 -- 172.21.15.18:0/3542267158 wait complete. 2024-09-19T08:47:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.475+0000 7f295dbd5740 20 client.15360 trim_cache size 0 max 16384 2024-09-19T08:47:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 Processor -- start 2024-09-19T08:47:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 -- start start 2024-09-19T08:47:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedf960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9c2e0 0x562fedfad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 0x562fedfb8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29541a8620 con 0x562fedfa1370 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f29541aaea0 con 0x562fedf9c2e0 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f295dbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29541a8c90 con 0x562fedf9b9a0 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f29593d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 0x562fedfb8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f29593d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 0x562fedfb8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59788/0 (socket says 172.21.15.18:59788) 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f2958bd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedf960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.491+0000 7f29593d9640 1 -- 172.21.15.18:0/2044420292 learned_addr learned my addr 172.21.15.18:0/2044420292 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f2953fff640 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9c2e0 0x562fedfad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f29593d9640 1 -- 172.21.15.18:0/2044420292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 msgr2=0x562fedf960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f29593d9640 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedf960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f29593d9640 1 -- 172.21.15.18:0/2044420292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9c2e0 msgr2=0x562fedfad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f29593d9640 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9c2e0 0x562fedfad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f29593d9640 1 -- 172.21.15.18:0/2044420292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fedf9c7c0 con 0x562fedfa1370 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f2953fff640 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9c2e0 0x562fedfad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f2958bd8640 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedf960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f29593d9640 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 0x562fedfb8430 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f294c00fa40 tx=0x7f294c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04d94ad89857ade server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f293e7fc640 1 -- 172.21.15.18:0/2044420292 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c02e070 con 0x562fedfa1370 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f293e7fc640 1 -- 172.21.15.18:0/2044420292 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f294c01e190 con 0x562fedfa1370 2024-09-19T08:47:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.492+0000 7f293e7fc640 1 -- 172.21.15.18:0/2044420292 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c029840 con 0x562fedfa1370 2024-09-19T08:47:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 -- 172.21.15.18:0/2044420292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 msgr2=0x562fedfb8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 0x562fedfb8430 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f294c00fa40 tx=0x7f294c019000 comp rx=0 tx=0).stop 2024-09-19T08:47:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 -- 172.21.15.18:0/2044420292 shutdown_connections 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedfa1370 0x562fedfb8430 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedf9c2e0 0x562fedfad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2044420292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedf960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 -- 172.21.15.18:0/2044420292 >> 172.21.15.18:0/2044420292 conn(0x562fedf97010 msgr2=0x562fedf959a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 -- 172.21.15.18:0/2044420292 shutdown_connections 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 -- 172.21.15.18:0/2044420292 wait complete. 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.493+0000 7f295dbd5740 1 -- start start 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 Processor -- start 2024-09-19T08:47:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedfaaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 0x562fedfac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29541a9360 con 0x562fedf9c2e0 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f29541aa7d0 con 0x562fedfa1370 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29541a9a30 con 0x562fedf9b9a0 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f295dbd5740 10 client.0 _ll_register_callbacks cb 0x7f29400f3d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f2953fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 0x562fedfac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f2958bd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedfaaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 0x562fedfac420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:46476/0 (socket says 172.21.15.18:46476) 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 -- 172.21.15.18:0/2372205109 learned_addr learned my addr 172.21.15.18:0/2372205109 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 -- 172.21.15.18:0/2372205109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 msgr2=0x562fedfaaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedfaaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 -- 172.21.15.18:0/2372205109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 msgr2=0x562fedfab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.494+0000 7f29593d9640 1 -- 172.21.15.18:0/2372205109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fedfaca30 con 0x562fedfa1370 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f29593d9640 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 0x562fedfac420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f294c009940 tx=0x7f294c01ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e8b9562a1cbed23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f2933fff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f2933fff640 1 -- 172.21.15.18:0/2372205109 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c02e070 con 0x562fedfa1370 2024-09-19T08:47:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f2933fff640 1 -- 172.21.15.18:0/2372205109 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f294c01e900 con 0x562fedfa1370 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f294c01e190 con 0x562fedfa1370 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f2933fff640 1 -- 172.21.15.18:0/2372205109 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f294c01eb00 con 0x562fedfa1370 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f295dbd5740 10 client.25004 fetch_fsmap learned FSMap version 21 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.495+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562fee01cb90 con 0x562fedfa1370 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f2933fff640 1 -- 172.21.15.18:0/2372205109 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f294c01e190 con 0x562fedfa1370 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f2933fff640 1 -- 172.21.15.18:0/2372205109 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f294c01a070 con 0x562fedfa1370 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f295dbd5740 10 client.25004 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f295dbd5740 10 client.25004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f295dbd5740 20 client.25004 populate_metadata read hostname 'smithi018' 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fee01d510 0x562fee01f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f295dbd5740 4 client.25004 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:47:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562fedf0ca20 con 0x562fee01d510 2024-09-19T08:47:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f2958bd8640 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fee01d510 0x562fee01f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f2958bd8640 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fee01d510 0x562fee01f930 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e1ae229d5833b73 server_cookie=f24285a891a3a6d7 in_seq=0 out_seq=0 2024-09-19T08:47:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.496+0000 7f2933fff640 10 client.25004 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f2933fff640 1 -- 172.21.15.18:0/2372205109 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562fedf0ca20 con 0x562fee01d510 2024-09-19T08:47:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f2933fff640 10 client.25004 handle_command_reply: tid=0 2024-09-19T08:47:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 client.25004 shutdown 2024-09-19T08:47:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 msgr2=0x562fedfac420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 0x562fedfac420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f294c009940 tx=0x7f294c01ee70 comp rx=0 tx=0).stop 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 shutdown_connections 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562fee01d510 0x562fee01f930 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562fedfa1370 0x562fedfac420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fedf9c2e0 0x562fedfab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f2933fff640 0 client.25004 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 --2- 172.21.15.18:0/2372205109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fedf9b9a0 0x562fedfaaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 >> 172.21.15.18:0/2372205109 conn(0x562fedf97010 msgr2=0x562fedf961c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 shutdown_connections 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.548+0000 7f295dbd5740 1 -- 172.21.15.18:0/2372205109 wait complete. 2024-09-19T08:47:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295dbd5740 20 client.25004 trim_cache size 0 max 16384 2024-09-19T08:47:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:47:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:47:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:47:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29440a32f0 msgr2=0x7f29440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29440a32f0 0x7f29440a57b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f294c005fd0 tx=0x7f294c004a40 comp rx=0 tx=0).stop 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 msgr2=0x7f2954198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 0x7f2954198280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2940005940 tx=0x7f29400042f0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 shutdown_connections 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f29440a32f0 0x7f29440a57b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29541025f0 0x7f295419f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2954101c30 0x7f2954198280 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 --2- 172.21.15.18:0/1410555565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954100a40 0x7f2954197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 >> 172.21.15.18:0/1410555565 conn(0x7f29540fc1e0 msgr2=0x7f2954104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 shutdown_connections 2024-09-19T08:47:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:47:57.549+0000 7f295ae3c640 1 -- 172.21.15.18:0/1410555565 wait complete. 2024-09-19T08:47:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:57 smithi150 ceph-mon[34610]: pgmap v429: 129 pgs: 129 active+clean; 37 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 348 op/s 2024-09-19T08:47:58.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:57 smithi162 ceph-mon[34870]: pgmap v429: 129 pgs: 129 active+clean; 37 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 348 op/s 2024-09-19T08:47:58.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:57 smithi018 ceph-mon[30956]: pgmap v429: 129 pgs: 129 active+clean; 37 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 348 op/s 2024-09-19T08:48:00.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:47:59 smithi150 ceph-mon[34610]: pgmap v430: 129 pgs: 129 active+clean; 37 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 312 op/s 2024-09-19T08:48:00.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:47:59 smithi162 ceph-mon[34870]: pgmap v430: 129 pgs: 129 active+clean; 37 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 312 op/s 2024-09-19T08:48:00.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:47:59 smithi018 ceph-mon[30956]: pgmap v430: 129 pgs: 129 active+clean; 37 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 312 op/s 2024-09-19T08:48:01.630 INFO:tasks.workunit.client.0.smithi018.stdout:10000 punch from 0x713e to 0x9907, (0x27c9 bytes) 2024-09-19T08:48:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:01 smithi150 ceph-mon[34610]: pgmap v431: 129 pgs: 129 active+clean; 39 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 560 op/s 2024-09-19T08:48:02.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:01 smithi162 ceph-mon[34870]: pgmap v431: 129 pgs: 129 active+clean; 39 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 560 op/s 2024-09-19T08:48:02.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:01 smithi018 ceph-mon[30956]: pgmap v431: 129 pgs: 129 active+clean; 39 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 560 op/s 2024-09-19T08:48:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:03 smithi150 ceph-mon[34610]: pgmap v432: 129 pgs: 129 active+clean; 35 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.0 MiB/s wr, 543 op/s 2024-09-19T08:48:04.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:03 smithi162 ceph-mon[34870]: pgmap v432: 129 pgs: 129 active+clean; 35 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.0 MiB/s wr, 543 op/s 2024-09-19T08:48:04.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:03 smithi018 ceph-mon[30956]: pgmap v432: 129 pgs: 129 active+clean; 35 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.0 MiB/s wr, 543 op/s 2024-09-19T08:48:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:05 smithi150 ceph-mon[34610]: pgmap v433: 129 pgs: 129 active+clean; 35 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 507 op/s 2024-09-19T08:48:06.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:05 smithi162 ceph-mon[34870]: pgmap v433: 129 pgs: 129 active+clean; 35 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 507 op/s 2024-09-19T08:48:06.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:05 smithi018 ceph-mon[30956]: pgmap v433: 129 pgs: 129 active+clean; 35 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 507 op/s 2024-09-19T08:48:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:07 smithi150 ceph-mon[34610]: pgmap v434: 129 pgs: 129 active+clean; 36 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.7 MiB/s wr, 747 op/s 2024-09-19T08:48:08.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:07 smithi162 ceph-mon[34870]: pgmap v434: 129 pgs: 129 active+clean; 36 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.7 MiB/s wr, 747 op/s 2024-09-19T08:48:08.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:07 smithi018 ceph-mon[30956]: pgmap v434: 129 pgs: 129 active+clean; 36 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.7 MiB/s wr, 747 op/s 2024-09-19T08:48:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:09 smithi150 ceph-mon[34610]: pgmap v435: 129 pgs: 129 active+clean; 36 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 550 op/s 2024-09-19T08:48:10.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:09 smithi162 ceph-mon[34870]: pgmap v435: 129 pgs: 129 active+clean; 36 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 550 op/s 2024-09-19T08:48:10.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:09 smithi018 ceph-mon[30956]: pgmap v435: 129 pgs: 129 active+clean; 36 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.9 MiB/s wr, 550 op/s 2024-09-19T08:48:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 -- 172.21.15.18:0/1476546288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238100a40 msgr2=0x7f0238100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 --2- 172.21.15.18:0/1476546288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238100a40 0x7f0238100e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0228009900 tx=0x7f022802a410 comp rx=0 tx=0).stop 2024-09-19T08:48:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 -- 172.21.15.18:0/1476546288 shutdown_connections 2024-09-19T08:48:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 --2- 172.21.15.18:0/1476546288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02381025f0 0x7f0238108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 --2- 172.21.15.18:0/1476546288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238101c30 0x7f02381020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 --2- 172.21.15.18:0/1476546288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238100a40 0x7f0238100e40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 -- 172.21.15.18:0/1476546288 >> 172.21.15.18:0/1476546288 conn(0x7f02380fc1e0 msgr2=0x7f02380fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 -- 172.21.15.18:0/1476546288 shutdown_connections 2024-09-19T08:48:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.646+0000 7f023c882640 1 -- 172.21.15.18:0/1476546288 wait complete. 2024-09-19T08:48:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 Processor -- start 2024-09-19T08:48:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 -- start start 2024-09-19T08:48:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 0x7f0238196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 0x7f0238197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02381025f0 0x7f023819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f023810c570 con 0x7f0238101c30 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.647+0000 7f023c882640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f023810c3f0 con 0x7f02381025f0 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f023c882640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f023810c6f0 con 0x7f0238100a40 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f023659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 0x7f0238196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 0x7f0238197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f023659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 0x7f0238196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46944/0 (socket says 172.21.15.18:46944) 2024-09-19T08:48:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f023659c640 1 -- 172.21.15.18:0/266432082 learned_addr learned my addr 172.21.15.18:0/266432082 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 0x7f0238197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39764/0 (socket says 172.21.15.18:39764) 2024-09-19T08:48:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0236d9d640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02381025f0 0x7f023819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 -- 172.21.15.18:0/266432082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 msgr2=0x7f0238196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 0x7f0238196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 -- 172.21.15.18:0/266432082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02381025f0 msgr2=0x7f023819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02381025f0 0x7f023819e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 -- 172.21.15.18:0/266432082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023819e850 con 0x7f0238101c30 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f023659c640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 0x7f0238196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f0235d9b640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 0x7f0238197180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f022c00e9f0 tx=0x7f022c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.648+0000 7f02277fe640 1 -- 172.21.15.18:0/266432082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c00ccc0 con 0x7f0238101c30 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.649+0000 7f02277fe640 1 -- 172.21.15.18:0/266432082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f022c005020 con 0x7f0238101c30 2024-09-19T08:48:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.649+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023819eb40 con 0x7f0238101c30 2024-09-19T08:48:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.649+0000 7f02277fe640 1 -- 172.21.15.18:0/266432082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c004a00 con 0x7f0238101c30 2024-09-19T08:48:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.649+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023819f090 con 0x7f0238101c30 2024-09-19T08:48:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.651+0000 7f023f622740 1 Processor -- start 2024-09-19T08:48:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 -- start start 2024-09-19T08:48:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae1bb0 0x561ee7ae1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 0x561ee7ae6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7ae9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561ee7a432f0 con 0x561ee7ae24f0 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561ee79eb270 con 0x561ee7ae1bb0 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023f622740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561ee7a3f2b0 con 0x561ee7ae7580 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f02277fe640 1 -- 172.21.15.18:0/266432082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f022c004ba0 con 0x7f0238101c30 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 0x561ee7ae6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 0x561ee7ae6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39778/0 (socket says 172.21.15.18:39778) 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae1bb0 0x561ee7ae1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 -- 172.21.15.18:0/2754378522 learned_addr learned my addr 172.21.15.18:0/2754378522 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f0235d9b640 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7ae9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 -- 172.21.15.18:0/2754378522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 msgr2=0x561ee7ae9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7ae9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 -- 172.21.15.18:0/2754378522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae1bb0 msgr2=0x561ee7ae1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae1bb0 0x561ee7ae1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f023659c640 1 -- 172.21.15.18:0/2754378522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ee79ea340 con 0x561ee7ae24f0 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f0235d9b640 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7ae9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.652+0000 7f0236d9d640 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae1bb0 0x561ee7ae1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f023659c640 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 0x561ee7ae6fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0228009230 tx=0x7f0228005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ebf980d4e538a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f02277fe640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f02200a3370 0x7f02200a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f0224ff9640 1 -- 172.21.15.18:0/2754378522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228035070 con 0x561ee7ae24f0 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f0224ff9640 1 -- 172.21.15.18:0/2754378522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02280035f0 con 0x561ee7ae24f0 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f0224ff9640 1 -- 172.21.15.18:0/2754378522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280044e0 con 0x561ee7ae24f0 2024-09-19T08:48:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f0236d9d640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f02200a3370 0x7f02200a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.653+0000 7f02277fe640 1 -- 172.21.15.18:0/266432082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f022c0cfc60 con 0x7f0238101c30 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- 172.21.15.18:0/2754378522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 msgr2=0x561ee7ae6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f0236d9d640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f02200a3370 0x7f02200a5830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0230005fd0 tx=0x7f02300096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 0x561ee7ae6fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0228009230 tx=0x7f0228005c00 comp rx=0 tx=0).stop 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- 172.21.15.18:0/2754378522 shutdown_connections 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7ae9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae24f0 0x561ee7ae6fb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- 172.21.15.18:0/2754378522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae1bb0 0x561ee7ae1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- 172.21.15.18:0/2754378522 >> 172.21.15.18:0/2754378522 conn(0x561ee7add220 msgr2=0x561ee7add620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- 172.21.15.18:0/2754378522 shutdown_connections 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- 172.21.15.18:0/2754378522 wait complete. 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- start start 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 Processor -- start 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7aec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7af32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561ee7aea4f0 con 0x561ee7ae1bb0 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561ee79cc290 con 0x561ee7ae24f0 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561ee7aea670 con 0x561ee7ae7580 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.654+0000 7f023f622740 10 client.0 _ll_register_callbacks cb 0x561ee79fd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7af32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f0235d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7aec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39794/0 (socket says 172.21.15.18:39794) 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 -- 172.21.15.18:0/491364848 learned_addr learned my addr 172.21.15.18:0/491364848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7af32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46960/0 (socket says 172.21.15.18:46960) 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 -- 172.21.15.18:0/491364848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 msgr2=0x561ee7af32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7af32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 -- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 msgr2=0x561ee7aec2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7aec2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 -- 172.21.15.18:0/491364848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ee7756210 con 0x561ee7ae1bb0 2024-09-19T08:48:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023659c640 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebdb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f02280092a0 tx=0x7f0228009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e84aca0b6c5701 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f021dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f021dffb640 1 -- 172.21.15.18:0/491364848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022804e020 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f021dffb640 1 -- 172.21.15.18:0/491364848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f0228003fd0 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02280035f0 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f021dffb640 1 -- 172.21.15.18:0/491364848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0228059050 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023f622740 10 client.15378 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.655+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561ee7822620 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f021dffb640 1 -- 172.21.15.18:0/491364848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02280035f0 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f021dffb640 1 -- 172.21.15.18:0/491364848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f022803c440 con 0x561ee7ae1bb0 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f023f622740 10 client.15378 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f023f622740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f023f622740 20 client.15378 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f023f622740 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7af75c0 0x561ee7af99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f023f622740 4 client.15378 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ee7a50a20 con 0x561ee7af75c0 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.656+0000 7f0235d9b640 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7af75c0 0x561ee7af99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f0235d9b640 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7af75c0 0x561ee7af99b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=124b72476549f396 server_cookie=92a3befcae12cc72 in_seq=0 out_seq=0 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f021dffb640 10 client.15378 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f021dffb640 1 -- 172.21.15.18:0/491364848 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ee7a50a20 con 0x561ee7af75c0 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f021dffb640 10 client.15378 handle_command_reply: tid=0 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f023f622740 1 client.15378 shutdown 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 msgr2=0x561ee7aebdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.657+0000 7f023f622740 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebdb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f02280092a0 tx=0x7f0228009520 comp rx=0 tx=0).stop 2024-09-19T08:48:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 shutdown_connections 2024-09-19T08:48:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7af75c0 0x561ee7af99b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae7580 0x561ee7af32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7aec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 --2- 172.21.15.18:0/491364848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebdb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 >> 172.21.15.18:0/491364848 conn(0x561ee7add220 msgr2=0x561ee7ada1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f021dffb640 0 client.15378 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 shutdown_connections 2024-09-19T08:48:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 1 -- 172.21.15.18:0/491364848 wait complete. 2024-09-19T08:48:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.658+0000 7f023f622740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T08:48:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 Processor -- start 2024-09-19T08:48:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 -- start start 2024-09-19T08:48:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7af3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 0x561ee7aec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02381a64d0 con 0x561ee7ae7580 2024-09-19T08:48:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f02381a8d50 con 0x561ee7ae24f0 2024-09-19T08:48:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023f622740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02381a6b40 con 0x561ee7ae1bb0 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 0x561ee7aec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 0x561ee7aec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39802/0 (socket says 172.21.15.18:39802) 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0236d9d640 1 -- 172.21.15.18:0/3720086594 learned_addr learned my addr 172.21.15.18:0/3720086594 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0235d9b640 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7af3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f023659c640 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0235d9b640 1 -- 172.21.15.18:0/3720086594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae1bb0 msgr2=0x561ee7aebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0235d9b640 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0235d9b640 1 -- 172.21.15.18:0/3720086594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 msgr2=0x561ee7aec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0235d9b640 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 0x561ee7aec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0235d9b640 1 -- 172.21.15.18:0/3720086594 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ee7ae3150 con 0x561ee7ae24f0 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.674+0000 7f0236d9d640 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 0x561ee7aec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.675+0000 7f0235d9b640 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7af3280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f022c0cd3e0 tx=0x7f022c0bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf4140d7ad112ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.675+0000 7f021ffff640 1 -- 172.21.15.18:0/3720086594 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c01c040 con 0x561ee7ae24f0 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.675+0000 7f021ffff640 1 -- 172.21.15.18:0/3720086594 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f022c09c5b0 con 0x561ee7ae24f0 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.675+0000 7f021ffff640 1 -- 172.21.15.18:0/3720086594 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c086040 con 0x561ee7ae24f0 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- 172.21.15.18:0/3720086594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 msgr2=0x561ee7af3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7af3280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f022c0cd3e0 tx=0x7f022c0bc040 comp rx=0 tx=0).stop 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- 172.21.15.18:0/3720086594 shutdown_connections 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae7580 0x561ee7aec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae24f0 0x561ee7af3280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- 172.21.15.18:0/3720086594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae1bb0 0x561ee7aebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- 172.21.15.18:0/3720086594 >> 172.21.15.18:0/3720086594 conn(0x561ee7add220 msgr2=0x561ee7add600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- 172.21.15.18:0/3720086594 shutdown_connections 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- 172.21.15.18:0/3720086594 wait complete. 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- start start 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 Processor -- start 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7af0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae24f0 0x561ee7af0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae7580 0x561ee7af1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02381a7210 con 0x561ee7ae1bb0 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f02381a8680 con 0x561ee7ae7580 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.676+0000 7f023f622740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02381a78e0 con 0x561ee7ae24f0 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f023f622740 10 client.0 _ll_register_callbacks cb 0x7f0230009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f023659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7af0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae24f0 0x561ee7af0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f023659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7af0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39818/0 (socket says 172.21.15.18:39818) 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f023659c640 1 -- 172.21.15.18:0/254936228 learned_addr learned my addr 172.21.15.18:0/254936228 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0236d9d640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae7580 0x561ee7af1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 -- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae7580 msgr2=0x561ee7af1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae7580 0x561ee7af1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 -- 172.21.15.18:0/254936228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 msgr2=0x561ee7af0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7af0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 -- 172.21.15.18:0/254936228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ee7af23b0 con 0x561ee7ae24f0 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0236d9d640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae7580 0x561ee7af1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f023659c640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7af0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f0235d9b640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae24f0 0x561ee7af0d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f022c09c760 tx=0x7f022c009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36367a8a0c74c4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f021dffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f021dffb640 1 -- 172.21.15.18:0/254936228 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c086050 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f021dffb640 1 -- 172.21.15.18:0/254936228 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f022c0051d0 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.677+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f022c09c5b0 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f021dffb640 1 -- 172.21.15.18:0/254936228 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f022c01c070 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 10 client.25102 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561ee7b62220 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f021dffb640 1 -- 172.21.15.18:0/254936228 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f022c09c5b0 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f021dffb640 1 -- 172.21.15.18:0/254936228 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f022c0ba070 con 0x561ee7ae24f0 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 10 client.25102 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 10 client.25102 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 20 client.25102 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7b62b00 0x561ee7b64ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 4 client.25102 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ee7a4ad70 con 0x561ee7b62b00 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.678+0000 7f023659c640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7b62b00 0x561ee7b64ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.679+0000 7f021dffb640 10 client.25102 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.679+0000 7f023659c640 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7b62b00 0x561ee7b64ef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54ceb6decb56570d server_cookie=88ee225bf06d5a98 in_seq=0 out_seq=0 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f021dffb640 1 -- 172.21.15.18:0/254936228 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ee7a4ad70 con 0x561ee7b62b00 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f021dffb640 10 client.25102 handle_command_reply: tid=0 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 client.25102 shutdown 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae24f0 msgr2=0x561ee7af0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae24f0 0x561ee7af0d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f022c09c760 tx=0x7f022c009f60 comp rx=0 tx=0).stop 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 shutdown_connections 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561ee7b62b00 0x561ee7b64ef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ee7ae7580 0x561ee7af1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ee7ae24f0 0x561ee7af0d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f021dffb640 0 client.25102 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 --2- 172.21.15.18:0/254936228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ee7ae1bb0 0x561ee7af0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 >> 172.21.15.18:0/254936228 conn(0x561ee7add220 msgr2=0x561ee7ad99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 shutdown_connections 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.693+0000 7f023f622740 1 -- 172.21.15.18:0/254936228 wait complete. 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023f622740 20 client.25102 trim_cache size 0 max 16384 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:48:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:48:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:48:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f02200a3370 msgr2=0x7f02200a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f02200a3370 0x7f02200a5830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0230005fd0 tx=0x7f02300096a0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 msgr2=0x7f0238197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 0x7f0238197180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f022c00e9f0 tx=0x7f022c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 shutdown_connections 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f02200a3370 0x7f02200a5830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02381025f0 0x7f023819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0238101c30 0x7f0238197180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 --2- 172.21.15.18:0/266432082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0238100a40 0x7f0238196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 >> 172.21.15.18:0/266432082 conn(0x7f02380fc1e0 msgr2=0x7f0238105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 shutdown_connections 2024-09-19T08:48:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:10.694+0000 7f023c882640 1 -- 172.21.15.18:0/266432082 wait complete. 2024-09-19T08:48:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:11 smithi150 ceph-mon[34610]: pgmap v436: 129 pgs: 129 active+clean; 38 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.6 MiB/s wr, 754 op/s 2024-09-19T08:48:12.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:11 smithi162 ceph-mon[34870]: pgmap v436: 129 pgs: 129 active+clean; 38 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.6 MiB/s wr, 754 op/s 2024-09-19T08:48:12.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:11 smithi018 ceph-mon[30956]: pgmap v436: 129 pgs: 129 active+clean; 38 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.6 MiB/s wr, 754 op/s 2024-09-19T08:48:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:13 smithi150 ceph-mon[34610]: pgmap v437: 129 pgs: 129 active+clean; 38 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 482 op/s 2024-09-19T08:48:14.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:13 smithi162 ceph-mon[34870]: pgmap v437: 129 pgs: 129 active+clean; 38 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 482 op/s 2024-09-19T08:48:14.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:13 smithi018 ceph-mon[30956]: pgmap v437: 129 pgs: 129 active+clean; 38 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 482 op/s 2024-09-19T08:48:14.728 INFO:tasks.workunit.client.0.smithi018.stdout:20000 punch from 0x9116f to 0x978af, (0x6740 bytes) 2024-09-19T08:48:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:15 smithi150 ceph-mon[34610]: pgmap v438: 129 pgs: 129 active+clean; 38 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 468 op/s 2024-09-19T08:48:16.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:15 smithi162 ceph-mon[34870]: pgmap v438: 129 pgs: 129 active+clean; 38 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 468 op/s 2024-09-19T08:48:16.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:15 smithi018 ceph-mon[30956]: pgmap v438: 129 pgs: 129 active+clean; 38 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 468 op/s 2024-09-19T08:48:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:17 smithi150 ceph-mon[34610]: pgmap v439: 129 pgs: 129 active+clean; 35 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.1 MiB/s wr, 687 op/s 2024-09-19T08:48:18.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:17 smithi162 ceph-mon[34870]: pgmap v439: 129 pgs: 129 active+clean; 35 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.1 MiB/s wr, 687 op/s 2024-09-19T08:48:18.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:17 smithi018 ceph-mon[30956]: pgmap v439: 129 pgs: 129 active+clean; 35 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.1 MiB/s wr, 687 op/s 2024-09-19T08:48:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:19.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:18 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:48:19.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:19.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:18 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:48:19.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:19.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:19.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:19.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:48:20.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:19 smithi150 ceph-mon[34610]: pgmap v440: 129 pgs: 129 active+clean; 35 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2024-09-19T08:48:20.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:19 smithi162 ceph-mon[34870]: pgmap v440: 129 pgs: 129 active+clean; 35 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2024-09-19T08:48:20.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:19 smithi018 ceph-mon[30956]: pgmap v440: 129 pgs: 129 active+clean; 35 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2024-09-19T08:48:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:21 smithi150 ceph-mon[34610]: pgmap v441: 129 pgs: 129 active+clean; 36 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.9 MiB/s wr, 640 op/s 2024-09-19T08:48:22.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:21 smithi162 ceph-mon[34870]: pgmap v441: 129 pgs: 129 active+clean; 36 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.9 MiB/s wr, 640 op/s 2024-09-19T08:48:22.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:21 smithi018 ceph-mon[30956]: pgmap v441: 129 pgs: 129 active+clean; 36 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.9 MiB/s wr, 640 op/s 2024-09-19T08:48:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 -- 172.21.15.18:0/575284587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4102d50 msgr2=0x7fbfc41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/575284587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4102d50 0x7fbfc41031d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009900 tx=0x7fbfb002a410 comp rx=0 tx=0).stop 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 -- 172.21.15.18:0/575284587 shutdown_connections 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/575284587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4103710 0x7fbfc4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/575284587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4102d50 0x7fbfc41031d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/575284587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 0x7fbfc4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 -- 172.21.15.18:0/575284587 >> 172.21.15.18:0/575284587 conn(0x7fbfc40fd2e0 msgr2=0x7fbfc40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 -- 172.21.15.18:0/575284587 shutdown_connections 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 -- 172.21.15.18:0/575284587 wait complete. 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.789+0000 7fbfcac5e640 1 Processor -- start 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 -- start start 2024-09-19T08:48:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 0x7fbfc4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4102d50 0x7fbfc4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 0x7fbfc419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc410d690 con 0x7fbfc4103710 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc410d510 con 0x7fbfc4102d50 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfcac5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc410d810 con 0x7fbfc4101b60 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 0x7fbfc419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc89fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 0x7fbfc4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 0x7fbfc419f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58396/0 (socket says 172.21.15.18:58396) 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 -- 172.21.15.18:0/2963295070 learned_addr learned my addr 172.21.15.18:0/2963295070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4102d50 0x7fbfc4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 -- 172.21.15.18:0/2963295070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 msgr2=0x7fbfc4197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 0x7fbfc4197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 -- 172.21.15.18:0/2963295070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4102d50 msgr2=0x7fbfc4198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4102d50 0x7fbfc4198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 -- 172.21.15.18:0/2963295070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc419f960 con 0x7fbfc4103710 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 0x7fbfc4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc91fb640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 0x7fbfc419f2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00eb10 tx=0x7fbfbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.790+0000 7fbfc1ffb640 1 -- 172.21.15.18:0/2963295070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc004b20 con 0x7fbfc4103710 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.791+0000 7fbfc1ffb640 1 -- 172.21.15.18:0/2963295070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfbc004cc0 con 0x7fbfc4103710 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.791+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc419fc50 con 0x7fbfc4103710 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.791+0000 7fbfc1ffb640 1 -- 172.21.15.18:0/2963295070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc010690 con 0x7fbfc4103710 2024-09-19T08:48:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.791+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc41a0170 con 0x7fbfc4103710 2024-09-19T08:48:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.793+0000 7fbfc1ffb640 1 -- 172.21.15.18:0/2963295070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbfbc005020 con 0x7fbfc4103710 2024-09-19T08:48:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.793+0000 7fbfcd9fb740 1 Processor -- start 2024-09-19T08:48:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.793+0000 7fbfcd9fb740 1 -- start start 2024-09-19T08:48:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x55955947dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 0x559559482da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x559559485830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5595593e12f0 con 0x55955947e2e0 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559559389270 con 0x559559483370 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc1ffb640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfb40a3370 0x7fbfb40a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595593dd2b0 con 0x55955947d9a0 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 0x559559482da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 0x559559482da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58408/0 (socket says 172.21.15.18:58408) 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 -- 172.21.15.18:0/2082240740 learned_addr learned my addr 172.21.15.18:0/2082240740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x55955947dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x559559485830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc91fb640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfb40a3370 0x7fbfb40a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc1ffb640 1 -- 172.21.15.18:0/2963295070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbfbc0d01f0 con 0x7fbfc4103710 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 -- 172.21.15.18:0/2082240740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 msgr2=0x55955947dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x55955947dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 -- 172.21.15.18:0/2082240740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 msgr2=0x559559485830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x559559485830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 -- 172.21.15.18:0/2082240740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559559388340 con 0x55955947e2e0 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 0x559559482da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80114f0 tx=0x7fbfb80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b05288f333fe7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.794+0000 7fbfc91fb640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfb40a3370 0x7fbfb40a5830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005ba0 tx=0x7fbfbc098040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfaeffd640 1 -- 172.21.15.18:0/2082240740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb801e070 con 0x55955947e2e0 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfaeffd640 1 -- 172.21.15.18:0/2082240740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfb80035f0 con 0x55955947e2e0 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfaeffd640 1 -- 172.21.15.18:0/2082240740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800f7c0 con 0x55955947e2e0 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/2082240740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 msgr2=0x559559482da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 0x559559482da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80114f0 tx=0x7fbfb80119b0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/2082240740 shutdown_connections 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x559559485830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947e2e0 0x559559482da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/2082240740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x55955947dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.795+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/2082240740 >> 172.21.15.18:0/2082240740 conn(0x559559479010 msgr2=0x559559479410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/2082240740 shutdown_connections 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/2082240740 wait complete. 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 -- start start 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 Processor -- start 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x559559487c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x559559488190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559559483370 0x55955948f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559559486340 con 0x559559483370 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55955936a290 con 0x55955947e2e0 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595594864c0 con 0x55955947d9a0 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfcd9fb740 10 client.0 _ll_register_callbacks cb 0x55955939b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559559483370 0x55955948f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.796+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x559559487c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x559559487c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:55330/0 (socket says 172.21.15.18:55330) 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1935408009 learned_addr learned my addr 172.21.15.18:0/1935408009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x559559488190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 msgr2=0x559559488190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x559559488190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1935408009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559559483370 msgr2=0x55955948f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559559483370 0x55955948f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1935408009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595590f4210 con 0x55955947d9a0 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x559559487c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0032fd0 tx=0x7fbfb0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871900ecd8b59ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfa3fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1935408009 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0035040 con 0x55955947d9a0 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1935408009 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbfb0031dc0 con 0x55955947d9a0 2024-09-19T08:48:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.797+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb80035f0 con 0x55955947d9a0 2024-09-19T08:48:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.801+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1935408009 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbfb0004030 con 0x55955947d9a0 2024-09-19T08:48:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.801+0000 7fbfcd9fb740 10 client.25114 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.801+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5595591c0620 con 0x55955947d9a0 2024-09-19T08:48:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1935408009 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfb80035f0 con 0x55955947d9a0 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1935408009 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbfb004e4d0 con 0x55955947d9a0 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfcd9fb740 10 client.25114 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfcd9fb740 10 client.25114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfcd9fb740 20 client.25114 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559493850 0x559559495cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfcd9fb740 4 client.25114 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595593eea20 con 0x559559493850 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.802+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559493850 0x559559495cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559493850 0x559559495cc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79dee6f2ca9ee07f server_cookie=9aaee4143546d5a3 in_seq=0 out_seq=0 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfa3fff640 10 client.25114 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1935408009 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595593eea20 con 0x559559493850 2024-09-19T08:48:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfa3fff640 10 client.25114 handle_command_reply: tid=0 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfcd9fb740 1 client.25114 shutdown 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 msgr2=0x559559487c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.803+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x559559487c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0032fd0 tx=0x7fbfb0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 shutdown_connections 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559493850 0x559559495cc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559559483370 0x55955948f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfa3fff640 0 client.25114 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x559559488190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1935408009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947d9a0 0x559559487c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 >> 172.21.15.18:0/1935408009 conn(0x559559479010 msgr2=0x55955947a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 shutdown_connections 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1935408009 wait complete. 2024-09-19T08:48:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.804+0000 7fbfcd9fb740 20 client.25114 trim_cache size 0 max 16384 2024-09-19T08:48:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 Processor -- start 2024-09-19T08:48:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 -- start start 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x559559479ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947e2e0 0x55955948f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x55955947a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41a8760 con 0x55955947d9a0 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41aafe0 con 0x559559483370 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41a8dd0 con 0x55955947e2e0 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.821+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x559559479ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x559559479ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58420/0 (socket says 172.21.15.18:58420) 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1900980313 learned_addr learned my addr 172.21.15.18:0/1900980313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947e2e0 0x55955948f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x55955947a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1900980313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947e2e0 msgr2=0x55955948f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947e2e0 0x55955948f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1900980313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 msgr2=0x55955947a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x55955947a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1900980313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559559486220 con 0x55955947d9a0 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x559559479ec0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbfb004e8d0 tx=0x7fbfb002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f989cfc2a72aa978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfae7fc640 1 -- 172.21.15.18:0/1900980313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0041070 con 0x55955947d9a0 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfae7fc640 1 -- 172.21.15.18:0/1900980313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfb004eac0 con 0x55955947d9a0 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.822+0000 7fbfae7fc640 1 -- 172.21.15.18:0/1900980313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0035070 con 0x55955947d9a0 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1900980313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 msgr2=0x559559479ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x559559479ec0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbfb004e8d0 tx=0x7fbfb002a410 comp rx=0 tx=0).stop 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1900980313 shutdown_connections 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559559483370 0x55955947a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55955947e2e0 0x55955948f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1900980313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x559559479ec0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1900980313 >> 172.21.15.18:0/1900980313 conn(0x559559479010 msgr2=0x559559487a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1900980313 shutdown_connections 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.823+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1900980313 wait complete. 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 -- start start 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 Processor -- start 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x55955948cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x55955948d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559559483370 0x55955948e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41a94a0 con 0x55955947d9a0 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41aa910 con 0x55955947e2e0 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41a9b70 con 0x559559483370 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfcd9fb740 10 client.0 _ll_register_callbacks cb 0x7fbfb00318f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x55955948cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x55955948cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58430/0 (socket says 172.21.15.18:58430) 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1243654097 learned_addr learned my addr 172.21.15.18:0/1243654097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x55955948d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559559483370 0x55955948e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1243654097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559559483370 msgr2=0x55955948e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559559483370 0x55955948e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 msgr2=0x55955948d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x55955948d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.824+0000 7fbfc3fff640 1 -- 172.21.15.18:0/1243654097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55955948e770 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfc3fff640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x55955948cc10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0031830 tx=0x7fbfb0005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a039bc9bdf94ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfa3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1243654097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0041070 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb004eac0 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1243654097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbfb00035f0 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1243654097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbfb0035040 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 10 client.15402 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559559502d40 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1243654097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfb004eac0 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1243654097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbfb0059660 con 0x55955947d9a0 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 10 client.15402 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 20 client.15402 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559503630 0x559559505a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 4 client.15402 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:48:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.825+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595594830f0 con 0x559559503630 2024-09-19T08:48:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.826+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559503630 0x559559505a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.826+0000 7fbfc89fa640 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559503630 0x559559505a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad0bdbfd173ece9 server_cookie=6cddfa108f22722f in_seq=0 out_seq=0 2024-09-19T08:48:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.826+0000 7fbfa3fff640 10 client.15402 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfa3fff640 1 -- 172.21.15.18:0/1243654097 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595594830f0 con 0x559559503630 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfa3fff640 10 client.15402 handle_command_reply: tid=0 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 client.15402 shutdown 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 msgr2=0x55955948cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x55955948cc10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0031830 tx=0x7fbfb0005e30 comp rx=0 tx=0).stop 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 shutdown_connections 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x559559503630 0x559559505a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559559483370 0x55955948e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55955947e2e0 0x55955948d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 --2- 172.21.15.18:0/1243654097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55955947d9a0 0x55955948cc10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfa3fff640 0 client.15402 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 >> 172.21.15.18:0/1243654097 conn(0x559559479010 msgr2=0x5595594779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 shutdown_connections 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 1 -- 172.21.15.18:0/1243654097 wait complete. 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.841+0000 7fbfcd9fb740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:48:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:48:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfb40a3370 msgr2=0x7fbfb40a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfb40a3370 0x7fbfb40a5830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005ba0 tx=0x7fbfbc098040 comp rx=0 tx=0).stop 2024-09-19T08:48:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 msgr2=0x7fbfc419f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 0x7fbfc419f2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00eb10 tx=0x7fbfbc00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 shutdown_connections 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbfb40a3370 0x7fbfb40a5830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc4103710 0x7fbfc419f2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4102d50 0x7fbfc4198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 --2- 172.21.15.18:0/2963295070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc4101b60 0x7fbfc4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 >> 172.21.15.18:0/2963295070 conn(0x7fbfc40fd2e0 msgr2=0x7fbfc41061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 shutdown_connections 2024-09-19T08:48:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:23.842+0000 7fbfcac5e640 1 -- 172.21.15.18:0/2963295070 wait complete. 2024-09-19T08:48:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:23 smithi150 ceph-mon[34610]: pgmap v442: 129 pgs: 129 active+clean; 36 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 415 op/s 2024-09-19T08:48:24.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:23 smithi162 ceph-mon[34870]: pgmap v442: 129 pgs: 129 active+clean; 36 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 415 op/s 2024-09-19T08:48:24.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:23 smithi018 ceph-mon[30956]: pgmap v442: 129 pgs: 129 active+clean; 36 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 415 op/s 2024-09-19T08:48:26.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:25 smithi150 ceph-mon[34610]: pgmap v443: 129 pgs: 129 active+clean; 36 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 413 op/s 2024-09-19T08:48:26.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:25 smithi162 ceph-mon[34870]: pgmap v443: 129 pgs: 129 active+clean; 36 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 413 op/s 2024-09-19T08:48:26.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:25 smithi018 ceph-mon[30956]: pgmap v443: 129 pgs: 129 active+clean; 36 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 413 op/s 2024-09-19T08:48:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:27 smithi150 ceph-mon[34610]: pgmap v444: 129 pgs: 129 active+clean; 37 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.7 MiB/s wr, 588 op/s 2024-09-19T08:48:28.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:27 smithi162 ceph-mon[34870]: pgmap v444: 129 pgs: 129 active+clean; 37 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.7 MiB/s wr, 588 op/s 2024-09-19T08:48:28.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:27 smithi018 ceph-mon[30956]: pgmap v444: 129 pgs: 129 active+clean; 37 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.7 MiB/s wr, 588 op/s 2024-09-19T08:48:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:29 smithi150 ceph-mon[34610]: pgmap v445: 129 pgs: 129 active+clean; 37 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 371 op/s 2024-09-19T08:48:30.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:29 smithi162 ceph-mon[34870]: pgmap v445: 129 pgs: 129 active+clean; 37 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 371 op/s 2024-09-19T08:48:30.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:29 smithi018 ceph-mon[30956]: pgmap v445: 129 pgs: 129 active+clean; 37 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 371 op/s 2024-09-19T08:48:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:31 smithi150 ceph-mon[34610]: pgmap v446: 129 pgs: 129 active+clean; 38 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.5 MiB/s wr, 550 op/s 2024-09-19T08:48:32.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:31 smithi162 ceph-mon[34870]: pgmap v446: 129 pgs: 129 active+clean; 38 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.5 MiB/s wr, 550 op/s 2024-09-19T08:48:32.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:31 smithi018 ceph-mon[30956]: pgmap v446: 129 pgs: 129 active+clean; 38 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.5 MiB/s wr, 550 op/s 2024-09-19T08:48:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:33 smithi150 ceph-mon[34610]: pgmap v447: 129 pgs: 129 active+clean; 38 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 357 op/s 2024-09-19T08:48:34.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:33 smithi162 ceph-mon[34870]: pgmap v447: 129 pgs: 129 active+clean; 38 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 357 op/s 2024-09-19T08:48:34.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:33 smithi018 ceph-mon[30956]: pgmap v447: 129 pgs: 129 active+clean; 38 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 357 op/s 2024-09-19T08:48:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:35 smithi150 ceph-mon[34610]: pgmap v448: 129 pgs: 129 active+clean; 38 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 357 op/s 2024-09-19T08:48:36.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:35 smithi162 ceph-mon[34870]: pgmap v448: 129 pgs: 129 active+clean; 38 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 357 op/s 2024-09-19T08:48:36.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:35 smithi018 ceph-mon[30956]: pgmap v448: 129 pgs: 129 active+clean; 38 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 357 op/s 2024-09-19T08:48:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 -- 172.21.15.18:0/4185785195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 msgr2=0x7fe0301020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 --2- 172.21.15.18:0/4185785195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 0x7fe0301020c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009900 tx=0x7fe01c02a410 comp rx=0 tx=0).stop 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 -- 172.21.15.18:0/4185785195 shutdown_connections 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 --2- 172.21.15.18:0/4185785195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030102600 0x7fe030108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 --2- 172.21.15.18:0/4185785195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 0x7fe0301020c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 --2- 172.21.15.18:0/4185785195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe030100a50 0x7fe030100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 -- 172.21.15.18:0/4185785195 >> 172.21.15.18:0/4185785195 conn(0x7fe0300fc1b0 msgr2=0x7fe0300fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 -- 172.21.15.18:0/4185785195 shutdown_connections 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 -- 172.21.15.18:0/4185785195 wait complete. 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 Processor -- start 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.940+0000 7fe036c67640 1 -- start start 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe036c67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 0x7fe030197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe036c67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 0x7fe030198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe036c67640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe030102600 0x7fe03019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe036c67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe03010c580 con 0x7fe030100a50 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe036c67640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe03010c400 con 0x7fe030102600 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe036c67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe03010c700 con 0x7fe030101c40 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 0x7fe030197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 0x7fe030197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56358/0 (socket says 172.21.15.18:56358) 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 -- 172.21.15.18:0/1327011176 learned_addr learned my addr 172.21.15.18:0/1327011176 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 0x7fe030198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe035204640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe030102600 0x7fe03019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 -- 172.21.15.18:0/1327011176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 msgr2=0x7fe030198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 0x7fe030198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 -- 172.21.15.18:0/1327011176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe030102600 msgr2=0x7fe03019f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe030102600 0x7fe03019f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 -- 172.21.15.18:0/1327011176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03019f960 con 0x7fe030100a50 2024-09-19T08:48:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.941+0000 7fe034a03640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 0x7fe030197d40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe02400e9c0 tx=0x7fe02400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.942+0000 7fe02dffb640 1 -- 172.21.15.18:0/1327011176 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02400cd80 con 0x7fe030100a50 2024-09-19T08:48:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.942+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03019fc50 con 0x7fe030100a50 2024-09-19T08:48:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.942+0000 7fe02dffb640 1 -- 172.21.15.18:0/1327011176 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0240035f0 con 0x7fe030100a50 2024-09-19T08:48:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.942+0000 7fe02dffb640 1 -- 172.21.15.18:0/1327011176 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024010690 con 0x7fe030100a50 2024-09-19T08:48:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.942+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0301a0170 con 0x7fe030100a50 2024-09-19T08:48:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe02dffb640 1 -- 172.21.15.18:0/1327011176 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe0240037a0 con 0x7fe030100a50 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 Processor -- start 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 -- start start 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb616c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb616c6f0 0x561bb61711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb6171780 0x561bb6173c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561bb60cb2f0 con 0x561bb616bdb0 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561bb6073270 con 0x561bb6171780 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe0399ff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561bb60c72b0 con 0x561bb616c6f0 2024-09-19T08:48:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe035204640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb616c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe035204640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb616c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56360/0 (socket says 172.21.15.18:56360) 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe035204640 1 -- 172.21.15.18:0/2045194 learned_addr learned my addr 172.21.15.18:0/2045194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe034a03640 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb616c6f0 0x561bb61711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe02ffff640 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb6171780 0x561bb6173c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.945+0000 7fe02dffb640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe0200a32f0 0x7fe0200a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 -- 172.21.15.18:0/2045194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb616c6f0 msgr2=0x561bb61711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb616c6f0 0x561bb61711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 -- 172.21.15.18:0/2045194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb6171780 msgr2=0x561bb6173c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb6171780 0x561bb6173c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 -- 172.21.15.18:0/2045194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb6072340 con 0x561bb616bdb0 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe034a03640 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb616c6f0 0x561bb61711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe02dffb640 1 -- 172.21.15.18:0/1327011176 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe0240d02c0 con 0x7fe030100a50 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe0200a32f0 0x7fe0200a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb616c1b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe0280104f0 tx=0x7fe0280109b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc20d5abaed795e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe01affd640 1 -- 172.21.15.18:0/2045194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028019070 con 0x561bb616bdb0 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe035204640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe0200a32f0 0x7fe0200a57b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe028021000 tx=0x7fe02801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe01affd640 1 -- 172.21.15.18:0/2045194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe02800edb0 con 0x561bb616bdb0 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.946+0000 7fe01affd640 1 -- 172.21.15.18:0/2045194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028011c70 con 0x561bb616bdb0 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 -- 172.21.15.18:0/2045194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 msgr2=0x561bb616c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb616c1b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe0280104f0 tx=0x7fe0280109b0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 -- 172.21.15.18:0/2045194 shutdown_connections 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb6171780 0x561bb6173c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb616c6f0 0x561bb61711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 --2- 172.21.15.18:0/2045194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb616c1b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 -- 172.21.15.18:0/2045194 >> 172.21.15.18:0/2045194 conn(0x561bb6163010 msgr2=0x561bb6163410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 -- 172.21.15.18:0/2045194 shutdown_connections 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 -- 172.21.15.18:0/2045194 wait complete. 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.947+0000 7fe0399ff740 1 -- start start 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 Processor -- start 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb6176010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb6176550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561bb6174750 con 0x561bb616c6f0 2024-09-19T08:48:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561bb6054290 con 0x561bb616bdb0 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561bb61748d0 con 0x561bb6171780 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe0399ff740 10 client.0 _ll_register_callbacks cb 0x561bb6085140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb6176550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb6176550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56370/0 (socket says 172.21.15.18:56370) 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe02ffff640 1 -- 172.21.15.18:0/3588173423 learned_addr learned my addr 172.21.15.18:0/3588173423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe035204640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.948+0000 7fe034a03640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb6176010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe02ffff640 1 -- 172.21.15.18:0/3588173423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 msgr2=0x561bb617d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe02ffff640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe02ffff640 1 -- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 msgr2=0x561bb6176010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe02ffff640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb6176010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe02ffff640 1 -- 172.21.15.18:0/3588173423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb5dde210 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe02ffff640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb6176550 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009900 tx=0x7fe01c031ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e079db8b3eab9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe00ffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe00ffff640 1 -- 172.21.15.18:0/3588173423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c035040 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe00ffff640 1 -- 172.21.15.18:0/3588173423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe01c004240 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe02800edb0 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe00ffff640 1 -- 172.21.15.18:0/3588173423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe01c04f050 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe0399ff740 10 client.15414 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561bb5eaa620 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.949+0000 7fe00ffff640 1 -- 172.21.15.18:0/3588173423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe02800edb0 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe00ffff640 1 -- 172.21.15.18:0/3588173423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe01c044020 con 0x561bb616c6f0 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe0399ff740 10 client.15414 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe0399ff740 10 client.15414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe0399ff740 20 client.15414 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb6181c30 0x561bb6184080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe0399ff740 4 client.15414 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bb60d8a20 con 0x561bb6181c30 2024-09-19T08:48:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe034a03640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb6181c30 0x561bb6184080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe034a03640 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb6181c30 0x561bb6184080 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7eb67f54041c960 server_cookie=620572051eed313c in_seq=0 out_seq=0 2024-09-19T08:48:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.950+0000 7fe00ffff640 10 client.15414 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe00ffff640 1 -- 172.21.15.18:0/3588173423 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561bb60d8a20 con 0x561bb6181c30 2024-09-19T08:48:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe00ffff640 10 client.15414 handle_command_reply: tid=0 2024-09-19T08:48:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 client.15414 shutdown 2024-09-19T08:48:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 msgr2=0x561bb6176550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb6176550 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009900 tx=0x7fe01c031ed0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 shutdown_connections 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb6181c30 0x561bb6184080 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb6176550 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3588173423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb6176010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 >> 172.21.15.18:0/3588173423 conn(0x561bb6163010 msgr2=0x561bb6164820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe00ffff640 0 client.15414 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 shutdown_connections 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 1 -- 172.21.15.18:0/3588173423 wait complete. 2024-09-19T08:48:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.951+0000 7fe0399ff740 20 client.15414 trim_cache size 0 max 16384 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 Processor -- start 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 -- start start 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb61620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb617d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb6164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0301a64e0 con 0x561bb616c6f0 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe0301a8d60 con 0x561bb616bdb0 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.969+0000 7fe0399ff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0301a6b50 con 0x561bb6171780 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb617d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb617d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56384/0 (socket says 172.21.15.18:56384) 2024-09-19T08:48:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe035204640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb6164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 -- 172.21.15.18:0/93394963 learned_addr learned my addr 172.21.15.18:0/93394963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe034a03640 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb61620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 -- 172.21.15.18:0/93394963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 msgr2=0x561bb6164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb6164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 -- 172.21.15.18:0/93394963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 msgr2=0x561bb61620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb61620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 -- 172.21.15.18:0/93394963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb6162e30 con 0x561bb616c6f0 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe02ffff640 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb617d550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe01c006010 tx=0x7fe01c005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0be06fdd485c880 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe01a7fc640 1 -- 172.21.15.18:0/93394963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c035070 con 0x561bb616c6f0 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe01a7fc640 1 -- 172.21.15.18:0/93394963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe01c046830 con 0x561bb616c6f0 2024-09-19T08:48:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.970+0000 7fe01a7fc640 1 -- 172.21.15.18:0/93394963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c003850 con 0x561bb616c6f0 2024-09-19T08:48:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 -- 172.21.15.18:0/93394963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 msgr2=0x561bb617d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb617d550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe01c006010 tx=0x7fe01c005e30 comp rx=0 tx=0).stop 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 -- 172.21.15.18:0/93394963 shutdown_connections 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb6164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616c6f0 0x561bb617d550 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 --2- 172.21.15.18:0/93394963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616bdb0 0x561bb61620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 -- 172.21.15.18:0/93394963 >> 172.21.15.18:0/93394963 conn(0x561bb6163010 msgr2=0x561bb61619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 -- 172.21.15.18:0/93394963 shutdown_connections 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.971+0000 7fe0399ff740 1 -- 172.21.15.18:0/93394963 wait complete. 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 -- start start 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 Processor -- start 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb617abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616c6f0 0x561bb617b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0301a7220 con 0x561bb616bdb0 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe0301a8690 con 0x561bb616c6f0 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0301a78f0 con 0x561bb6171780 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe0399ff740 10 client.0 _ll_register_callbacks cb 0x7fe01c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb617abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb617abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56394/0 (socket says 172.21.15.18:56394) 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 -- 172.21.15.18:0/3642886253 learned_addr learned my addr 172.21.15.18:0/3642886253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe02ffff640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616c6f0 0x561bb617b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe035204640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 -- 172.21.15.18:0/3642886253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 msgr2=0x561bb617c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 -- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616c6f0 msgr2=0x561bb617b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616c6f0 0x561bb617b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.972+0000 7fe034a03640 1 -- 172.21.15.18:0/3642886253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb617c710 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe034a03640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb617abb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0240cdd60 tx=0x7fe0240057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cf18fd35aa0665 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe00ffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe00ffff640 1 -- 172.21.15.18:0/3642886253 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02409c050 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe01c046830 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe00ffff640 1 -- 172.21.15.18:0/3642886253 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe024098b80 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe00ffff640 1 -- 172.21.15.18:0/3642886253 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0240d0120 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 10 client.15420 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561bb61eca10 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe00ffff640 1 -- 172.21.15.18:0/3642886253 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe01c046830 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe00ffff640 1 -- 172.21.15.18:0/3642886253 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe024098260 con 0x561bb616bdb0 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 10 client.15420 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 10 client.15420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 20 client.15420 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb61ed310 0x561bb61ef700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 4 client.15420 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.973+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561bb60d2d70 con 0x561bb61ed310 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.974+0000 7fe02ffff640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb61ed310 0x561bb61ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.974+0000 7fe02ffff640 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb61ed310 0x561bb61ef700 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a739eba3fa55c221 server_cookie=9ca7f003385f97bf in_seq=0 out_seq=0 2024-09-19T08:48:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.974+0000 7fe00ffff640 10 client.15420 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.989+0000 7fe00ffff640 1 -- 172.21.15.18:0/3642886253 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561bb60d2d70 con 0x561bb61ed310 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.989+0000 7fe00ffff640 10 client.15420 handle_command_reply: tid=0 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.989+0000 7fe0399ff740 1 client.15420 shutdown 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 msgr2=0x561bb617abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb617abb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0240cdd60 tx=0x7fe0240057d0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 shutdown_connections 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561bb61ed310 0x561bb61ef700 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bb6171780 0x561bb617c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bb616c6f0 0x561bb617b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 --2- 172.21.15.18:0/3642886253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb616bdb0 0x561bb617abb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe00ffff640 0 client.15420 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 >> 172.21.15.18:0/3642886253 conn(0x561bb6163010 msgr2=0x561bb61621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 shutdown_connections 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 1 -- 172.21.15.18:0/3642886253 wait complete. 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.990+0000 7fe0399ff740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:48:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:48:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe0200a32f0 msgr2=0x7fe0200a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe0200a32f0 0x7fe0200a57b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe028021000 tx=0x7fe02801e000 comp rx=0 tx=0).stop 2024-09-19T08:48:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 msgr2=0x7fe030197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 0x7fe030197d40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe02400e9c0 tx=0x7fe02400ee80 comp rx=0 tx=0).stop 2024-09-19T08:48:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 shutdown_connections 2024-09-19T08:48:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe0200a32f0 0x7fe0200a57b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe030102600 0x7fe03019f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe030101c40 0x7fe030198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 --2- 172.21.15.18:0/1327011176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe030100a50 0x7fe030197d40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 >> 172.21.15.18:0/1327011176 conn(0x7fe0300fc1b0 msgr2=0x7fe03006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 shutdown_connections 2024-09-19T08:48:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:36.991+0000 7fe036c67640 1 -- 172.21.15.18:0/1327011176 wait complete. 2024-09-19T08:48:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:37 smithi150 ceph-mon[34610]: pgmap v449: 129 pgs: 129 active+clean; 39 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.3 MiB/s wr, 525 op/s 2024-09-19T08:48:38.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:37 smithi162 ceph-mon[34870]: pgmap v449: 129 pgs: 129 active+clean; 39 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.3 MiB/s wr, 525 op/s 2024-09-19T08:48:38.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:37 smithi018 ceph-mon[30956]: pgmap v449: 129 pgs: 129 active+clean; 39 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.3 MiB/s wr, 525 op/s 2024-09-19T08:48:39.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:38 smithi162 ceph-mon[34870]: pgmap v450: 129 pgs: 129 active+clean; 39 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 350 op/s 2024-09-19T08:48:39.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:38 smithi018 ceph-mon[30956]: pgmap v450: 129 pgs: 129 active+clean; 39 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 350 op/s 2024-09-19T08:48:39.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:38 smithi150 ceph-mon[34610]: pgmap v450: 129 pgs: 129 active+clean; 39 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 350 op/s 2024-09-19T08:48:41.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:41 smithi150 ceph-mon[34610]: pgmap v451: 129 pgs: 129 active+clean; 36 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 509 op/s 2024-09-19T08:48:41.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:41 smithi162 ceph-mon[34870]: pgmap v451: 129 pgs: 129 active+clean; 36 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 509 op/s 2024-09-19T08:48:41.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:41 smithi018 ceph-mon[30956]: pgmap v451: 129 pgs: 129 active+clean; 36 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 509 op/s 2024-09-19T08:48:43.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:43 smithi150 ceph-mon[34610]: pgmap v452: 129 pgs: 129 active+clean; 36 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2024-09-19T08:48:43.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:43 smithi162 ceph-mon[34870]: pgmap v452: 129 pgs: 129 active+clean; 36 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2024-09-19T08:48:43.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:43 smithi018 ceph-mon[30956]: pgmap v452: 129 pgs: 129 active+clean; 36 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2024-09-19T08:48:45.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:45 smithi150 ceph-mon[34610]: pgmap v453: 129 pgs: 129 active+clean; 36 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2024-09-19T08:48:45.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:45 smithi162 ceph-mon[34870]: pgmap v453: 129 pgs: 129 active+clean; 36 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2024-09-19T08:48:45.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:45 smithi018 ceph-mon[30956]: pgmap v453: 129 pgs: 129 active+clean; 36 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2024-09-19T08:48:47.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:47 smithi150 ceph-mon[34610]: pgmap v454: 129 pgs: 129 active+clean; 37 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.8 MiB/s wr, 484 op/s 2024-09-19T08:48:47.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:47 smithi162 ceph-mon[34870]: pgmap v454: 129 pgs: 129 active+clean; 37 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.8 MiB/s wr, 484 op/s 2024-09-19T08:48:47.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:47 smithi018 ceph-mon[30956]: pgmap v454: 129 pgs: 129 active+clean; 37 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.8 MiB/s wr, 484 op/s 2024-09-19T08:48:49.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:49 smithi150 ceph-mon[34610]: pgmap v455: 129 pgs: 129 active+clean; 37 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 316 op/s 2024-09-19T08:48:49.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:49 smithi162 ceph-mon[34870]: pgmap v455: 129 pgs: 129 active+clean; 37 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 316 op/s 2024-09-19T08:48:49.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:49 smithi018 ceph-mon[30956]: pgmap v455: 129 pgs: 129 active+clean; 37 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 316 op/s 2024-09-19T08:48:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3318369673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 msgr2=0x7fbd78104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3318369673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78104a40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009900 tx=0x7fbd6802a410 comp rx=0 tx=0).stop 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3318369673 shutdown_connections 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3318369673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd781078b0 0x7fbd78109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3318369673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd78104f80 0x7fbd78107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3318369673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78104a40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3318369673 >> 172.21.15.18:0/3318369673 conn(0x7fbd780fc1b0 msgr2=0x7fbd780fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3318369673 shutdown_connections 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3318369673 wait complete. 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 Processor -- start 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.091+0000 7fbd7c9b7640 1 -- start start 2024-09-19T08:48:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7c9b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7c9b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd78104f80 0x7fbd78100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7c9b7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd781078b0 0x7fbd78100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7c9b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7810d6f0 con 0x7fbd78102650 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7c9b7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7810d570 con 0x7fbd781078b0 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7c9b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7810d870 con 0x7fbd78104f80 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33368/0 (socket says 172.21.15.18:33368) 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 -- 172.21.15.18:0/3522205613 learned_addr learned my addr 172.21.15.18:0/3522205613 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd78104f80 0x7fbd78100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd781078b0 0x7fbd78100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 -- 172.21.15.18:0/3522205613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd78104f80 msgr2=0x7fbd78100600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd78104f80 0x7fbd78100600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 -- 172.21.15.18:0/3522205613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd781078b0 msgr2=0x7fbd78100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd781078b0 0x7fbd78100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 -- 172.21.15.18:0/3522205613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd781013d0 con 0x7fbd78102650 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd7659c640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78101fc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd68005940 tx=0x7fbd680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.092+0000 7fbd677fe640 1 -- 172.21.15.18:0/3522205613 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6803f030 con 0x7fbd78102650 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.093+0000 7fbd677fe640 1 -- 172.21.15.18:0/3522205613 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd680318f0 con 0x7fbd78102650 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.093+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd781a1e20 con 0x7fbd78102650 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.093+0000 7fbd677fe640 1 -- 172.21.15.18:0/3522205613 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68035070 con 0x7fbd78102650 2024-09-19T08:48:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.093+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd781a2230 con 0x7fbd78102650 2024-09-19T08:48:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.095+0000 7fbd677fe640 1 -- 172.21.15.18:0/3522205613 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbd68042030 con 0x7fbd78102650 2024-09-19T08:48:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.095+0000 7fbd7f82d740 1 Processor -- start 2024-09-19T08:48:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 -- start start 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5f0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555afc54c2f0 con 0x555afc5ee370 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x555afc4f4270 con 0x555afc5e89a0 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555afc5482b0 con 0x555afc5e92e0 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:48512/0 (socket says 172.21.15.18:48512) 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1569361389 learned_addr learned my addr 172.21.15.18:0/1569361389 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd677fe640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbd600a32f0 0x7fbd600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1569361389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 msgr2=0x555afc5edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1569361389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 msgr2=0x555afc5f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1569361389 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555afc4f3340 con 0x555afc5e89a0 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.096+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.097+0000 7fbd677fe640 1 -- 172.21.15.18:0/3522205613 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbd680f0160 con 0x7fbd78102650 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.097+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5e8da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009f80 tx=0x7fbd70010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05fdc04e94f9f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.097+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbd600a32f0 0x7fbd600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.097+0000 7fbd64ff9640 1 -- 172.21.15.18:0/1569361389 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70004030 con 0x555afc5e89a0 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.097+0000 7fbd64ff9640 1 -- 172.21.15.18:0/1569361389 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd70004700 con 0x555afc5e89a0 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.097+0000 7fbd64ff9640 1 -- 172.21.15.18:0/1569361389 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7001b420 con 0x555afc5e89a0 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1569361389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 msgr2=0x555afc5e8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbd600a32f0 0x7fbd600a57b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009fd0 tx=0x7fbd7001ba70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5e8da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009f80 tx=0x7fbd70010860 comp rx=0 tx=0).stop 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1569361389 shutdown_connections 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1569361389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5e8da0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1569361389 >> 172.21.15.18:0/1569361389 conn(0x555afc5e4010 msgr2=0x555afc5e4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1569361389 shutdown_connections 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1569361389 wait complete. 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.098+0000 7fbd7f82d740 1 -- start start 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 Processor -- start 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555afc5f1340 con 0x555afc5ee370 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x555afc4d5290 con 0x555afc5e89a0 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555afc5f14c0 con 0x555afc5e92e0 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7f82d740 10 client.0 _ll_register_callbacks cb 0x555afc506140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5fa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33380/0 (socket says 172.21.15.18:33380) 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd7659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1378061833 learned_addr learned my addr 172.21.15.18:0/1378061833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1378061833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 msgr2=0x555afc5f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 msgr2=0x555afc5f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1378061833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555afc25f210 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.099+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5fa1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbd70011eb0 tx=0x7fbd70018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471c90c52c57f77c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1378061833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7002d040 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1378061833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbd70011700 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd70004700 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1378061833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbd7001b420 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 10 client.15432 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555afc32b620 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1378061833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd70004700 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1378061833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbd70027460 con 0x555afc5ee370 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 10 client.15432 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 10 client.15432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 20 client.15432 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.100+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5fe750 0x555afc600b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.101+0000 7fbd7f82d740 4 client.15432 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.101+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555afc559a20 con 0x555afc5fe750 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.101+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5fe750 0x555afc600b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.101+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5fe750 0x555afc600b40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7c2e39a58e734f server_cookie=cafee9931f391e34 in_seq=0 out_seq=0 2024-09-19T08:48:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.101+0000 7fbd5dffb640 10 client.15432 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1378061833 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555afc559a20 con 0x555afc5fe750 2024-09-19T08:48:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd5dffb640 10 client.15432 handle_command_reply: tid=0 2024-09-19T08:48:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 client.15432 shutdown 2024-09-19T08:48:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 msgr2=0x555afc5fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5fa1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbd70011eb0 tx=0x7fbd70018000 comp rx=0 tx=0).stop 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 shutdown_connections 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5fe750 0x555afc600b40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5ee370 0x555afc5fa1a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd5dffb640 0 client.15432 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1378061833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 >> 172.21.15.18:0/1378061833 conn(0x555afc5e4010 msgr2=0x555afc5e5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 shutdown_connections 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1378061833 wait complete. 2024-09-19T08:48:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.102+0000 7fbd7f82d740 20 client.15432 trim_cache size 0 max 16384 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 Processor -- start 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 -- start start 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e4010 0x555afc5e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5fa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 0x555afc6053f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781aa990 con 0x555afc5e92e0 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781ad210 con 0x555afc5e89a0 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781ab000 con 0x555afc5e4010 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 0x555afc6053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 0x555afc6053f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33390/0 (socket says 172.21.15.18:33390) 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e4010 0x555afc5e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd76d9d640 1 -- 172.21.15.18:0/1086141148 learned_addr learned my addr 172.21.15.18:0/1086141148 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd75d9b640 1 -- 172.21.15.18:0/1086141148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e4010 msgr2=0x555afc5e30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e4010 0x555afc5e30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd75d9b640 1 -- 172.21.15.18:0/1086141148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 msgr2=0x555afc6053f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 0x555afc6053f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd75d9b640 1 -- 172.21.15.18:0/1086141148 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555afc5f2180 con 0x555afc5e89a0 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.118+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e4010 0x555afc5e30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.119+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 0x555afc6053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.119+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5fa160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x555afc5e4e90 tx=0x7fbd6c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d76f65424723ade server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.119+0000 7fbd5ffff640 1 -- 172.21.15.18:0/1086141148 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c022070 con 0x555afc5e89a0 2024-09-19T08:48:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.119+0000 7fbd5ffff640 1 -- 172.21.15.18:0/1086141148 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd6c0035f0 con 0x555afc5e89a0 2024-09-19T08:48:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.119+0000 7fbd5ffff640 1 -- 172.21.15.18:0/1086141148 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c01d6a0 con 0x555afc5e89a0 2024-09-19T08:48:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1086141148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 msgr2=0x555afc5fa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5fa160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x555afc5e4e90 tx=0x7fbd6c005f90 comp rx=0 tx=0).stop 2024-09-19T08:48:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1086141148 shutdown_connections 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e92e0 0x555afc6053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5fa160 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1086141148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e4010 0x555afc5e30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1086141148 >> 172.21.15.18:0/1086141148 conn(0x555afc5edec0 msgr2=0x555afc5e29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1086141148 shutdown_connections 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1086141148 wait complete. 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 -- start start 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 Processor -- start 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.120+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 0x555afc5f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781ab6d0 con 0x555afc5e4010 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781acb40 con 0x555afc5e89a0 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781abda0 con 0x555afc5e92e0 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 10 client.0 _ll_register_callbacks cb 0x7fbd7002a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 0x555afc5f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 0x555afc5f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33398/0 (socket says 172.21.15.18:33398) 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 -- 172.21.15.18:0/1754509833 learned_addr learned my addr 172.21.15.18:0/1754509833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd76d9d640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 -- 172.21.15.18:0/1754509833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 msgr2=0x555afc5f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 -- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 msgr2=0x555afc5f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 -- 172.21.15.18:0/1754509833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555afc5f9a00 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7659c640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 0x555afc5f7ea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd680bc340 tx=0x7fbd680bc250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5787f9f9e5c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1754509833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68049040 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1754509833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbd680ba450 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd6c0035f0 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1754509833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbd6803b460 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 10 client.15438 fetch_fsmap learned FSMap version 21 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.121+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555afc669ab0 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1754509833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd6c0035f0 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1754509833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbd680b8a20 con 0x555afc5e4010 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd7f82d740 10 client.15438 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd7f82d740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd7f82d740 20 client.15438 populate_metadata read hostname 'smithi018' 2024-09-19T08:48:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5ee370 0x555afc66c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd7f82d740 4 client.15438 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:48:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555afc553d70 con 0x555afc5ee370 2024-09-19T08:48:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5ee370 0x555afc66c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd75d9b640 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5ee370 0x555afc66c420 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea2d1d10c6ff0ac server_cookie=d62c2bab03208c9b in_seq=0 out_seq=0 2024-09-19T08:48:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.122+0000 7fbd5dffb640 10 client.15438 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd5dffb640 1 -- 172.21.15.18:0/1754509833 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555afc553d70 con 0x555afc5ee370 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd5dffb640 10 client.15438 handle_command_reply: tid=0 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 client.15438 shutdown 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 msgr2=0x555afc5f7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 0x555afc5f7ea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd680bc340 tx=0x7fbd680bc250 comp rx=0 tx=0).stop 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 shutdown_connections 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x555afc5ee370 0x555afc66c420 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555afc5e92e0 0x555afc5f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555afc5e89a0 0x555afc5f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 --2- 172.21.15.18:0/1754509833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555afc5e4010 0x555afc5f7ea0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd5dffb640 0 client.15438 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 >> 172.21.15.18:0/1754509833 conn(0x555afc5edec0 msgr2=0x555afc5e31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 shutdown_connections 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 1 -- 172.21.15.18:0/1754509833 wait complete. 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.135+0000 7fbd7f82d740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:48:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:48:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbd600a32f0 msgr2=0x7fbd600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbd600a32f0 0x7fbd600a57b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009fd0 tx=0x7fbd7001ba70 comp rx=0 tx=0).stop 2024-09-19T08:48:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 msgr2=0x7fbd78101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78101fc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd68005940 tx=0x7fbd680042f0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 shutdown_connections 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbd600a32f0 0x7fbd600a57b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd781078b0 0x7fbd78100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd78104f80 0x7fbd78100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 --2- 172.21.15.18:0/3522205613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd78102650 0x7fbd78101fc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 >> 172.21.15.18:0/3522205613 conn(0x7fbd780fc1b0 msgr2=0x7fbd78102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 shutdown_connections 2024-09-19T08:48:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:48:50.136+0000 7fbd7c9b7640 1 -- 172.21.15.18:0/3522205613 wait complete. 2024-09-19T08:48:51.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:51 smithi150 ceph-mon[34610]: pgmap v456: 129 pgs: 129 active+clean; 37 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 461 op/s 2024-09-19T08:48:51.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:51 smithi162 ceph-mon[34870]: pgmap v456: 129 pgs: 129 active+clean; 37 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 461 op/s 2024-09-19T08:48:51.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:51 smithi018 ceph-mon[30956]: pgmap v456: 129 pgs: 129 active+clean; 37 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 461 op/s 2024-09-19T08:48:53.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:53 smithi150 ceph-mon[34610]: pgmap v457: 129 pgs: 129 active+clean; 37 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 302 op/s 2024-09-19T08:48:53.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:53 smithi162 ceph-mon[34870]: pgmap v457: 129 pgs: 129 active+clean; 37 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 302 op/s 2024-09-19T08:48:53.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:53 smithi018 ceph-mon[30956]: pgmap v457: 129 pgs: 129 active+clean; 37 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 302 op/s 2024-09-19T08:48:55.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:55 smithi150 ceph-mon[34610]: pgmap v458: 129 pgs: 129 active+clean; 37 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 301 op/s 2024-09-19T08:48:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:55 smithi162 ceph-mon[34870]: pgmap v458: 129 pgs: 129 active+clean; 37 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 301 op/s 2024-09-19T08:48:55.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:55 smithi018 ceph-mon[30956]: pgmap v458: 129 pgs: 129 active+clean; 37 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 301 op/s 2024-09-19T08:48:57.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:57 smithi150 ceph-mon[34610]: pgmap v459: 129 pgs: 129 active+clean; 34 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.5 MiB/s wr, 448 op/s 2024-09-19T08:48:57.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:57 smithi162 ceph-mon[34870]: pgmap v459: 129 pgs: 129 active+clean; 34 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.5 MiB/s wr, 448 op/s 2024-09-19T08:48:57.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:57 smithi018 ceph-mon[30956]: pgmap v459: 129 pgs: 129 active+clean; 34 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.5 MiB/s wr, 448 op/s 2024-09-19T08:48:59.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:48:59 smithi150 ceph-mon[34610]: pgmap v460: 129 pgs: 129 active+clean; 34 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 294 op/s 2024-09-19T08:48:59.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:48:59 smithi162 ceph-mon[34870]: pgmap v460: 129 pgs: 129 active+clean; 34 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 294 op/s 2024-09-19T08:48:59.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:48:59 smithi018 ceph-mon[30956]: pgmap v460: 129 pgs: 129 active+clean; 34 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 294 op/s 2024-09-19T08:49:01.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:01 smithi150 ceph-mon[34610]: pgmap v461: 129 pgs: 129 active+clean; 36 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-09-19T08:49:01.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:01 smithi162 ceph-mon[34870]: pgmap v461: 129 pgs: 129 active+clean; 36 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-09-19T08:49:01.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:01 smithi018 ceph-mon[30956]: pgmap v461: 129 pgs: 129 active+clean; 36 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-09-19T08:49:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 -- 172.21.15.18:0/3211911615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8105900 msgr2=0x7ff0a810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3211911615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8105900 0x7ff0a810c190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009ca0 tx=0x7ff0a002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 -- 172.21.15.18:0/3211911615 shutdown_connections 2024-09-19T08:49:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3211911615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8105900 0x7ff0a810c190 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3211911615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a8104f40 0x7ff0a81053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3211911615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a8103d50 0x7ff0a8104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 -- 172.21.15.18:0/3211911615 >> 172.21.15.18:0/3211911615 conn(0x7ff0a80ff4b0 msgr2=0x7ff0a81018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 -- 172.21.15.18:0/3211911615 shutdown_connections 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.231+0000 7ff0afe30640 1 -- 172.21.15.18:0/3211911615 wait complete. 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 Processor -- start 2024-09-19T08:49:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 -- start start 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 0x7ff0a8199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a8104f40 0x7ff0a819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a8105900 0x7ff0a81a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810f8b0 con 0x7ff0a8103d50 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810f730 con 0x7ff0a8104f40 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0afe30640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810fa30 con 0x7ff0a8105900 2024-09-19T08:49:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 0x7ff0a8199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 0x7ff0a8199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39298/0 (socket says 172.21.15.18:39298) 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0adbcc640 1 -- 172.21.15.18:0/3059750303 learned_addr learned my addr 172.21.15.18:0/3059750303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a8105900 0x7ff0a81a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.232+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a8104f40 0x7ff0a819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0adbcc640 1 -- 172.21.15.18:0/3059750303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a8105900 msgr2=0x7ff0a81a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a8105900 0x7ff0a81a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0adbcc640 1 -- 172.21.15.18:0/3059750303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a8104f40 msgr2=0x7ff0a819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a8104f40 0x7ff0a819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0adbcc640 1 -- 172.21.15.18:0/3059750303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a81a1a90 con 0x7ff0a8103d50 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 0x7ff0a8199e70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e9c0 tx=0x7ff0a400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff09effd640 1 -- 172.21.15.18:0/3059750303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400cd80 con 0x7ff0a8103d50 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a81a1d80 con 0x7ff0a8103d50 2024-09-19T08:49:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff09effd640 1 -- 172.21.15.18:0/3059750303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0a40035f0 con 0x7ff0a8103d50 2024-09-19T08:49:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff09effd640 1 -- 172.21.15.18:0/3059750303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4010690 con 0x7ff0a8103d50 2024-09-19T08:49:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.233+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81a21f0 con 0x7ff0a8103d50 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 Processor -- start 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 -- start start 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d11da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff09effd640 1 -- 172.21.15.18:0/3059750303 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0a40037a0 con 0x7ff0a8103d50 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d17370 0x563294d19830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563294c752f0 con 0x563294d119a0 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563294c1d270 con 0x563294d122e0 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.236+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563294c712b0 con 0x563294d17370 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0ae3cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d11da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0ae3cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d11da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39306/0 (socket says 172.21.15.18:39306) 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0ae3cd640 1 -- 172.21.15.18:0/2118896988 learned_addr learned my addr 172.21.15.18:0/2118896988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d17370 0x563294d19830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2118896988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d17370 msgr2=0x563294d19830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d17370 0x563294d19830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2118896988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 msgr2=0x563294d11da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d11da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2118896988 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563294c1c340 con 0x563294d122e0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d16da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40cd750 tx=0x7ff0a40d81a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d27a17a15187799 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.237+0000 7ff093fff640 1 -- 172.21.15.18:0/2118896988 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40e3070 con 0x563294d122e0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff093fff640 1 -- 172.21.15.18:0/2118896988 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0a40d8e50 con 0x563294d122e0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff093fff640 1 -- 172.21.15.18:0/2118896988 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40de400 con 0x563294d122e0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff09effd640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff0940a32f0 0x7ff0940a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff0940a32f0 0x7ff0940a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff09effd640 1 -- 172.21.15.18:0/3059750303 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff0a40d0050 con 0x7ff0a8103d50 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2118896988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 msgr2=0x563294d16da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff0940a32f0 0x7ff0940a57b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0006010 tx=0x7ff0a0004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d16da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40cd750 tx=0x7ff0a40d81a0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2118896988 shutdown_connections 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d17370 0x563294d19830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d16da0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2118896988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.238+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2118896988 >> 172.21.15.18:0/2118896988 conn(0x563294d0d010 msgr2=0x563294d0d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2118896988 shutdown_connections 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2118896988 wait complete. 2024-09-19T08:49:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 -- start start 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 Processor -- start 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 0x563294d1bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d1c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d17370 0x563294d23140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563294d1a340 con 0x563294d17370 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563294bfe290 con 0x563294d122e0 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563294d1a4c0 con 0x563294d119a0 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.239+0000 7ff0b2bc8740 10 client.0 _ll_register_callbacks cb 0x563294c2f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 0x563294d1bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0ae3cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d17370 0x563294d23140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 0x563294d1bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:37610/0 (socket says 172.21.15.18:37610) 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2252730725 learned_addr learned my addr 172.21.15.18:0/2252730725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 msgr2=0x563294d1c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d1c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2252730725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d17370 msgr2=0x563294d23140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d17370 0x563294d23140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 -- 172.21.15.18:0/2252730725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563294988210 con 0x563294d119a0 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d17370 0x563294d23140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 0x563294d1bbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0a409bfa0 tx=0x7ff0a400c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2854437e46e5a916 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0917fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:49:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0917fa640 1 -- 172.21.15.18:0/2252730725 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4098540 con 0x563294d119a0 2024-09-19T08:49:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0917fa640 1 -- 172.21.15.18:0/2252730725 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff0a409a5a0 con 0x563294d119a0 2024-09-19T08:49:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.240+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a40d8e50 con 0x563294d119a0 2024-09-19T08:49:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0917fa640 1 -- 172.21.15.18:0/2252730725 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0a409bc00 con 0x563294d119a0 2024-09-19T08:49:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 10 client.25168 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563294a54620 con 0x563294d119a0 2024-09-19T08:49:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0917fa640 1 -- 172.21.15.18:0/2252730725 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0a40d8e50 con 0x563294d119a0 2024-09-19T08:49:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0917fa640 1 -- 172.21.15.18:0/2252730725 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0a40b5100 con 0x563294d119a0 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 10 client.25168 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 10 client.25168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 20 client.25168 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d27440 0x563294d29830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 4 client.25168 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563294c82a20 con 0x563294d27440 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.241+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d27440 0x563294d29830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0917fa640 10 client.25168 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d27440 0x563294d29830 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f92924b413c655e server_cookie=156fbd51602dc5b3 in_seq=0 out_seq=0 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0917fa640 1 -- 172.21.15.18:0/2252730725 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563294c82a20 con 0x563294d27440 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0917fa640 10 client.25168 handle_command_reply: tid=0 2024-09-19T08:49:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0b2bc8740 1 client.25168 shutdown 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 msgr2=0x563294d1bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.242+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 0x563294d1bbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0a409bfa0 tx=0x7ff0a400c7d0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 shutdown_connections 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d27440 0x563294d29830 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d17370 0x563294d23140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d122e0 0x563294d1c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0917fa640 0 client.25168 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/2252730725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d119a0 0x563294d1bbc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 >> 172.21.15.18:0/2252730725 conn(0x563294d0d010 msgr2=0x563294d0e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 shutdown_connections 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/2252730725 wait complete. 2024-09-19T08:49:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.243+0000 7ff0b2bc8740 20 client.25168 trim_cache size 0 max 16384 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 Processor -- start 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 -- start start 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d0c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d23100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d0e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81aa8f0 con 0x563294d119a0 2024-09-19T08:49:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81ad170 con 0x563294d17370 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.258+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81aaf60 con 0x563294d122e0 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d0c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d0c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39324/0 (socket says 172.21.15.18:39324) 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 -- 172.21.15.18:0/1607700454 learned_addr learned my addr 172.21.15.18:0/1607700454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d23100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d0e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 -- 172.21.15.18:0/1607700454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 msgr2=0x563294d23100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d23100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 -- 172.21.15.18:0/1607700454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 msgr2=0x563294d0e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d0e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 -- 172.21.15.18:0/1607700454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563294d0dca0 con 0x563294d119a0 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d0c9b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40058c0 tx=0x7ff0a400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff6363f3aef95e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0937fe640 1 -- 172.21.15.18:0/1607700454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a409bde0 con 0x563294d119a0 2024-09-19T08:49:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0937fe640 1 -- 172.21.15.18:0/1607700454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0a40d3900 con 0x563294d119a0 2024-09-19T08:49:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.259+0000 7ff0937fe640 1 -- 172.21.15.18:0/1607700454 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a409c070 con 0x563294d119a0 2024-09-19T08:49:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/1607700454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 msgr2=0x563294d0c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d0c9b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40058c0 tx=0x7ff0a400c840 comp rx=0 tx=0).stop 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/1607700454 shutdown_connections 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d0e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d23100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/1607700454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d0c9b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/1607700454 >> 172.21.15.18:0/1607700454 conn(0x563294d0d010 msgr2=0x563294d0dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/1607700454 shutdown_connections 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/1607700454 wait complete. 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.260+0000 7ff0b2bc8740 1 -- start start 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 Processor -- start 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d20780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d20cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d21c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81ab630 con 0x563294d119a0 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81acaa0 con 0x563294d17370 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81abd00 con 0x563294d122e0 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0b2bc8740 10 client.0 _ll_register_callbacks cb 0x7ff0a40e1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d20780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d20780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39340/0 (socket says 172.21.15.18:39340) 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 -- 172.21.15.18:0/533722583 learned_addr learned my addr 172.21.15.18:0/533722583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d20cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d21c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 -- 172.21.15.18:0/533722583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 msgr2=0x563294d20cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d20cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 -- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 msgr2=0x563294d21c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d21c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0adbcc640 1 -- 172.21.15.18:0/533722583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563294d22290 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.261+0000 7ff0ae3cd640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d21c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0adbcc640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d20780 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff0a409a550 tx=0x7ff0a4003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8eec4e503c9da43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0917fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0917fa640 1 -- 172.21.15.18:0/533722583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a409c070 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0917fa640 1 -- 172.21.15.18:0/533722583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff0a40b5100 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a40d3900 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0917fa640 1 -- 172.21.15.18:0/533722583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0a4098540 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 10 client.15456 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563294d22290 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0917fa640 1 -- 172.21.15.18:0/533722583 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0a40d3900 con 0x563294d119a0 2024-09-19T08:49:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0917fa640 1 -- 172.21.15.18:0/533722583 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0a409c500 con 0x563294d119a0 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 10 client.15456 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 20 client.15456 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d923f0 0x563294d947e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 4 client.15456 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.262+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563294c7cd70 con 0x563294d923f0 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.263+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d923f0 0x563294d947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.263+0000 7ff0917fa640 10 client.15456 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.263+0000 7ff0ad3cb640 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d923f0 0x563294d947e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50937886414f03a1 server_cookie=a4bb232de11b29d0 in_seq=0 out_seq=0 2024-09-19T08:49:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.276+0000 7ff0917fa640 1 -- 172.21.15.18:0/533722583 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563294c7cd70 con 0x563294d923f0 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.276+0000 7ff0917fa640 10 client.15456 handle_command_reply: tid=0 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 client.15456 shutdown 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 msgr2=0x563294d20780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d20780 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff0a409a550 tx=0x7ff0a4003e30 comp rx=0 tx=0).stop 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 shutdown_connections 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563294d923f0 0x563294d947e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563294d17370 0x563294d21c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563294d122e0 0x563294d20cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 --2- 172.21.15.18:0/533722583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563294d119a0 0x563294d20780 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0917fa640 0 client.15456 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 >> 172.21.15.18:0/533722583 conn(0x563294d0d010 msgr2=0x563294d0e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 shutdown_connections 2024-09-19T08:49:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 1 -- 172.21.15.18:0/533722583 wait complete. 2024-09-19T08:49:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.277+0000 7ff0b2bc8740 20 client.15456 trim_cache size 0 max 16384 2024-09-19T08:49:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:49:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:49:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:49:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff0940a32f0 msgr2=0x7ff0940a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff0940a32f0 0x7ff0940a57b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0006010 tx=0x7ff0a0004a80 comp rx=0 tx=0).stop 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 msgr2=0x7ff0a8199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 0x7ff0a8199e70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e9c0 tx=0x7ff0a400ee80 comp rx=0 tx=0).stop 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 shutdown_connections 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff0940a32f0 0x7ff0940a57b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a8105900 0x7ff0a81a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0a8104f40 0x7ff0a819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 --2- 172.21.15.18:0/3059750303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0a8103d50 0x7ff0a8199e70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 >> 172.21.15.18:0/3059750303 conn(0x7ff0a80ff4b0 msgr2=0x7ff0a81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 shutdown_connections 2024-09-19T08:49:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:03.278+0000 7ff0afe30640 1 -- 172.21.15.18:0/3059750303 wait complete. 2024-09-19T08:49:03.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:03 smithi150 ceph-mon[34610]: pgmap v462: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 298 op/s 2024-09-19T08:49:03.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:03 smithi162 ceph-mon[34870]: pgmap v462: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 298 op/s 2024-09-19T08:49:03.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:03 smithi018 ceph-mon[30956]: pgmap v462: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 298 op/s 2024-09-19T08:49:05.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:05 smithi150 ceph-mon[34610]: pgmap v463: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2024-09-19T08:49:05.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:05 smithi162 ceph-mon[34870]: pgmap v463: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2024-09-19T08:49:05.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:05 smithi018 ceph-mon[30956]: pgmap v463: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2024-09-19T08:49:07.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:07 smithi150 ceph-mon[34610]: pgmap v464: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 439 op/s 2024-09-19T08:49:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:07 smithi162 ceph-mon[34870]: pgmap v464: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 439 op/s 2024-09-19T08:49:07.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:07 smithi018 ceph-mon[30956]: pgmap v464: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 439 op/s 2024-09-19T08:49:09.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:09 smithi150 ceph-mon[34610]: pgmap v465: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 294 op/s 2024-09-19T08:49:09.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:09 smithi162 ceph-mon[34870]: pgmap v465: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 294 op/s 2024-09-19T08:49:09.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:09 smithi018 ceph-mon[30956]: pgmap v465: 129 pgs: 129 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 294 op/s 2024-09-19T08:49:10.434 INFO:tasks.workunit.client.0.smithi018.stdout:50000 write 0x39280 thru 0x48ee3 (0xfc64 bytes) 2024-09-19T08:49:10.434 INFO:tasks.workunit.client.0.smithi018.stdout:All 50000 operations completed A-OK! 2024-09-19T08:49:10.434 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-19T08:49:10.435 INFO:tasks.workunit.client.0.smithi018.stdout:Seed set to 1 2024-09-19T08:49:10.572 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T08:49:10.572 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T08:49:10.572 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T08:49:10.572 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T08:49:10.575 INFO:tasks.workunit.client.0.smithi018.stdout:skipping zero length punch hole 2024-09-19T08:49:10.577 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0x81c806 2024-09-19T08:49:10.690 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0x9bc582 2024-09-19T08:49:10.709 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0x9eecbc 2024-09-19T08:49:11.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:11 smithi150 ceph-mon[34610]: pgmap v466: 129 pgs: 129 active+clean; 37 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.3 MiB/s wr, 435 op/s 2024-09-19T08:49:11.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:11 smithi162 ceph-mon[34870]: pgmap v466: 129 pgs: 129 active+clean; 37 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.3 MiB/s wr, 435 op/s 2024-09-19T08:49:11.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:11 smithi018 ceph-mon[30956]: pgmap v466: 129 pgs: 129 active+clean; 37 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.3 MiB/s wr, 435 op/s 2024-09-19T08:49:13.007 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0x9f2a70 2024-09-19T08:49:13.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:13 smithi150 ceph-mon[34610]: pgmap v467: 129 pgs: 129 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 306 op/s 2024-09-19T08:49:13.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:13 smithi162 ceph-mon[34870]: pgmap v467: 129 pgs: 129 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 306 op/s 2024-09-19T08:49:13.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:13 smithi018 ceph-mon[30956]: pgmap v467: 129 pgs: 129 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 306 op/s 2024-09-19T08:49:15.056 INFO:tasks.workunit.client.0.smithi018.stdout:copying to largest ever: 0x9fdd84 2024-09-19T08:49:15.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:15 smithi150 ceph-mon[34610]: pgmap v468: 129 pgs: 129 active+clean; 43 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 364 op/s 2024-09-19T08:49:15.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:15 smithi162 ceph-mon[34870]: pgmap v468: 129 pgs: 129 active+clean; 43 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 364 op/s 2024-09-19T08:49:15.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:15 smithi018 ceph-mon[30956]: pgmap v468: 129 pgs: 129 active+clean; 43 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 364 op/s 2024-09-19T08:49:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 -- 172.21.15.18:0/1202097000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac1025f0 msgr2=0x7f6dac108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/1202097000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac1025f0 0x7f6dac108e80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009ca0 tx=0x7f6da402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 -- 172.21.15.18:0/1202097000 shutdown_connections 2024-09-19T08:49:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/1202097000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac1025f0 0x7f6dac108e80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/1202097000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac101c30 0x7f6dac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/1202097000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac100a40 0x7f6dac100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 -- 172.21.15.18:0/1202097000 >> 172.21.15.18:0/1202097000 conn(0x7f6dac0fc1e0 msgr2=0x7f6dac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 -- 172.21.15.18:0/1202097000 shutdown_connections 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 -- 172.21.15.18:0/1202097000 wait complete. 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 Processor -- start 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 -- start start 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.390+0000 7f6db2d8f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 0x7f6dac199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db2d8f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac101c30 0x7f6dac19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db2d8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac1025f0 0x7f6dac1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db2d8f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac10f8a0 con 0x7f6dac100a40 2024-09-19T08:49:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db2d8f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac10f720 con 0x7f6dac101c30 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db2d8f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac10fa20 con 0x7f6dac1025f0 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 0x7f6dac199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac101c30 0x7f6dac19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 0x7f6dac199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45316/0 (socket says 172.21.15.18:45316) 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac101c30 0x7f6dac19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:53800/0 (socket says 172.21.15.18:53800) 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 -- 172.21.15.18:0/4146826944 learned_addr learned my addr 172.21.15.18:0/4146826944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db132c640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac1025f0 0x7f6dac1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 -- 172.21.15.18:0/4146826944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac1025f0 msgr2=0x7f6dac1a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac1025f0 0x7f6dac1a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 -- 172.21.15.18:0/4146826944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac101c30 msgr2=0x7f6dac19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac101c30 0x7f6dac19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 -- 172.21.15.18:0/4146826944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac1a1ac0 con 0x7f6dac100a40 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db132c640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac1025f0 0x7f6dac1a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db0b2b640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 0x7f6dac199ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6da000e9c0 tx=0x7f6da000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6da9ffb640 1 -- 172.21.15.18:0/4146826944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da000cd80 con 0x7f6dac100a40 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac1a1db0 con 0x7f6dac100a40 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6da9ffb640 1 -- 172.21.15.18:0/4146826944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da00035f0 con 0x7f6dac100a40 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.391+0000 7f6da9ffb640 1 -- 172.21.15.18:0/4146826944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0010690 con 0x7f6dac100a40 2024-09-19T08:49:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.392+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac1a2220 con 0x7f6dac100a40 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.394+0000 7f6da9ffb640 1 -- 172.21.15.18:0/4146826944 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6da00037a0 con 0x7f6dac100a40 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.394+0000 7f6db5bff740 1 Processor -- start 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.394+0000 7f6db5bff740 1 -- start start 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.394+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.394+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20cdfcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.394+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdff830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db5bff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d20cd5b2f0 con 0x55d20cdf79a0 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db5bff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d20cd03270 con 0x55d20cdf82e0 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db5bff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d20cd572b0 con 0x55d20cdfd370 2024-09-19T08:49:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45332/0 (socket says 172.21.15.18:45332) 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db0b2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20cdfcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 -- 172.21.15.18:0/4185601201 learned_addr learned my addr 172.21.15.18:0/4185601201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6dabfff640 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 -- 172.21.15.18:0/4185601201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 msgr2=0x55d20cdff830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdff830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 -- 172.21.15.18:0/4185601201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 msgr2=0x55d20cdfcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20cdfcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 -- 172.21.15.18:0/4185601201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20cd02340 con 0x55d20cdf79a0 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6dabfff640 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6da9ffb640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6d9c0a32f0 0x7f6d9c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db0b2b640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6d9c0a32f0 0x7f6d9c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6db132c640 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf7da0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6da402aeb0 tx=0x7f6da40093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8768d907ce1af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.395+0000 7f6da9ffb640 1 -- 172.21.15.18:0/4146826944 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6da00d0050 con 0x7f6dac100a40 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.396+0000 7f6d96ffd640 1 -- 172.21.15.18:0/4185601201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4031d40 con 0x55d20cdf79a0 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.396+0000 7f6d96ffd640 1 -- 172.21.15.18:0/4185601201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da4036030 con 0x55d20cdf79a0 2024-09-19T08:49:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.396+0000 7f6d96ffd640 1 -- 172.21.15.18:0/4185601201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40047c0 con 0x55d20cdf79a0 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 -- 172.21.15.18:0/4185601201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 msgr2=0x55d20cdf7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf7da0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6da402aeb0 tx=0x7f6da40093e0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db0b2b640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6d9c0a32f0 0x7f6d9c0a57b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6da00cdaf0 tx=0x7f6da00d3b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 -- 172.21.15.18:0/4185601201 shutdown_connections 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20cdfcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 --2- 172.21.15.18:0/4185601201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf7da0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 -- 172.21.15.18:0/4185601201 >> 172.21.15.18:0/4185601201 conn(0x55d20cdf3010 msgr2=0x55d20cdf3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 -- 172.21.15.18:0/4185601201 shutdown_connections 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 -- 172.21.15.18:0/4185601201 wait complete. 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 -- start start 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.397+0000 7f6db5bff740 1 Processor -- start 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf79a0 0x55d20ce019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf82e0 0x55d20ce01f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce08f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d20ce00160 con 0x55d20cdfd370 2024-09-19T08:49:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d20cce4290 con 0x55d20cdf79a0 2024-09-19T08:49:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d20ce002e0 con 0x55d20cdf82e0 2024-09-19T08:49:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db5bff740 10 client.0 _ll_register_callbacks cb 0x55d20cd15140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce08f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce08f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45346/0 (socket says 172.21.15.18:45346) 2024-09-19T08:49:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 -- 172.21.15.18:0/2231454012 learned_addr learned my addr 172.21.15.18:0/2231454012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf79a0 0x55d20ce019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf82e0 0x55d20ce01f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 -- 172.21.15.18:0/2231454012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf82e0 msgr2=0x55d20ce01f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf82e0 0x55d20ce01f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 -- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf79a0 msgr2=0x55d20ce019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf79a0 0x55d20ce019e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 -- 172.21.15.18:0/2231454012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20ca6e210 con 0x55d20cdfd370 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.398+0000 7f6db132c640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce08f60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6da4004160 tx=0x7f6da402b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af91a77fc8d3ac48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6d8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2231454012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4059060 con 0x55d20cdfd370 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2231454012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6da4003d80 con 0x55d20cdfd370 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da4036030 con 0x55d20cdfd370 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2231454012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6da4004b40 con 0x55d20cdfd370 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6db5bff740 10 client.15468 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.399+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d20cb3a620 con 0x55d20cdfd370 2024-09-19T08:49:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2231454012 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da4036030 con 0x55d20cdfd370 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2231454012 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6da4043070 con 0x55d20cdfd370 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6db5bff740 10 client.15468 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6db5bff740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6db5bff740 20 client.15468 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce0d370 0x55d20ce0f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6db5bff740 4 client.15468 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d20cd68a20 con 0x55d20ce0d370 2024-09-19T08:49:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.400+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce0d370 0x55d20ce0f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.401+0000 7f6d8bfff640 10 client.15468 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.401+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce0d370 0x55d20ce0f760 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de33cd96bd343ae server_cookie=5321535815497b4e in_seq=0 out_seq=0 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.402+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2231454012 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d20cd68a20 con 0x55d20ce0d370 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.402+0000 7f6d8bfff640 10 client.15468 handle_command_reply: tid=0 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.402+0000 7f6db5bff740 1 client.15468 shutdown 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 msgr2=0x55d20ce08f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce08f60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6da4004160 tx=0x7f6da402b040 comp rx=0 tx=0).stop 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 shutdown_connections 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce0d370 0x55d20ce0f760 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce08f60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf82e0 0x55d20ce01f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2231454012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf79a0 0x55d20ce019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 >> 172.21.15.18:0/2231454012 conn(0x55d20cdf3010 msgr2=0x55d20cdf4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6d8bfff640 0 client.15468 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 shutdown_connections 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 1 -- 172.21.15.18:0/2231454012 wait complete. 2024-09-19T08:49:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.403+0000 7f6db5bff740 20 client.15468 trim_cache size 0 max 16384 2024-09-19T08:49:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 Processor -- start 2024-09-19T08:49:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 -- start start 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce08ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdf1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac1aa830 con 0x55d20cdf79a0 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac1ad0b0 con 0x55d20cdf82e0 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db5bff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac1aaea0 con 0x55d20cdfd370 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45362/0 (socket says 172.21.15.18:45362) 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.425+0000 7f6db132c640 1 -- 172.21.15.18:0/2982856938 learned_addr learned my addr 172.21.15.18:0/2982856938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce08ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdf1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 -- 172.21.15.18:0/2982856938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 msgr2=0x55d20cdf1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdf1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 -- 172.21.15.18:0/2982856938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 msgr2=0x55d20ce08ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce08ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 -- 172.21.15.18:0/2982856938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20ce0fd40 con 0x55d20cdf79a0 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6db132c640 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf19a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6da402b0b0 tx=0x7f6da4031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fa8aadcf63daf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6d967fc640 1 -- 172.21.15.18:0/2982856938 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4045730 con 0x55d20cdf79a0 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6d967fc640 1 -- 172.21.15.18:0/2982856938 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da4036070 con 0x55d20cdf79a0 2024-09-19T08:49:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.426+0000 7f6d967fc640 1 -- 172.21.15.18:0/2982856938 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4045e60 con 0x55d20cdf79a0 2024-09-19T08:49:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 -- 172.21.15.18:0/2982856938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 msgr2=0x55d20cdf19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf19a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6da402b0b0 tx=0x7f6da4031bd0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 -- 172.21.15.18:0/2982856938 shutdown_connections 2024-09-19T08:49:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdfd370 0x55d20cdf1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce08ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2982856938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdf79a0 0x55d20cdf19a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 -- 172.21.15.18:0/2982856938 >> 172.21.15.18:0/2982856938 conn(0x55d20cdf3010 msgr2=0x55d20ce019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 -- 172.21.15.18:0/2982856938 shutdown_connections 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 -- 172.21.15.18:0/2982856938 wait complete. 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 -- start start 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.427+0000 7f6db5bff740 1 Processor -- start 2024-09-19T08:49:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf79a0 0x55d20ce06500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce06a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce07a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac1ab570 con 0x55d20cdfd370 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac1ac9e0 con 0x55d20cdf82e0 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac1abc40 con 0x55d20cdf79a0 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db132c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce07a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce06a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce06a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:53818/0 (socket says 172.21.15.18:53818) 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 -- 172.21.15.18:0/2979680181 learned_addr learned my addr 172.21.15.18:0/2979680181 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db5bff740 10 client.0 _ll_register_callbacks cb 0x7f6da00d3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db132c640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce07a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45364/0 (socket says 172.21.15.18:45364) 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6db132c640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf79a0 0x55d20ce06500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 -- 172.21.15.18:0/2979680181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf79a0 msgr2=0x55d20ce06500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf79a0 0x55d20ce06500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 -- 172.21.15.18:0/2979680181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 msgr2=0x55d20ce07a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce07a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.428+0000 7f6dabfff640 1 -- 172.21.15.18:0/2979680181 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20ce08060 con 0x55d20cdf82e0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6dabfff640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce06a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55d20cdf3e90 tx=0x7f6d98020410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca9485050f0362bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6d8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2979680181 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98004250 con 0x55d20cdf82e0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2979680181 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6d980043f0 con 0x55d20cdf82e0 2024-09-19T08:49:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da4036070 con 0x55d20cdf82e0 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2979680181 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6d98005020 con 0x55d20cdf82e0 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6db5bff740 10 client.25112 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.429+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d20ce77fb0 con 0x55d20cdf82e0 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2979680181 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da4036070 con 0x55d20cdf82e0 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2979680181 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6d980035f0 con 0x55d20cdf82e0 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db5bff740 10 client.25112 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db5bff740 10 client.25112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db5bff740 20 client.25112 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce789c0 0x55d20ce7ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db5bff740 4 client.25112 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d20cd62d70 con 0x55d20ce789c0 2024-09-19T08:49:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.430+0000 7f6db132c640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce789c0 0x55d20ce7ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.431+0000 7f6d8bfff640 10 client.25112 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.431+0000 7f6db132c640 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce789c0 0x55d20ce7ade0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa5ac3ffb09ee14 server_cookie=ef6667ad9aab885a in_seq=0 out_seq=0 2024-09-19T08:49:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.446+0000 7f6d8bfff640 1 -- 172.21.15.18:0/2979680181 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d20cd62d70 con 0x55d20ce789c0 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.446+0000 7f6d8bfff640 10 client.25112 handle_command_reply: tid=0 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.446+0000 7f6db5bff740 1 client.25112 shutdown 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.446+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 msgr2=0x55d20ce06a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.446+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce06a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55d20cdf3e90 tx=0x7f6d98020410 comp rx=0 tx=0).stop 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 shutdown_connections 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55d20ce789c0 0x55d20ce7ade0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d20cdfd370 0x55d20ce07a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6d8bfff640 0 client.25112 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d20cdf82e0 0x55d20ce06a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 --2- 172.21.15.18:0/2979680181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d20cdf79a0 0x55d20ce06500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 >> 172.21.15.18:0/2979680181 conn(0x55d20cdf3010 msgr2=0x55d20cdf3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 shutdown_connections 2024-09-19T08:49:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 1 -- 172.21.15.18:0/2979680181 wait complete. 2024-09-19T08:49:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.447+0000 7f6db5bff740 20 client.25112 trim_cache size 0 max 16384 2024-09-19T08:49:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:49:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:49:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:49:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:49:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6d9c0a32f0 msgr2=0x7f6d9c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6d9c0a32f0 0x7f6d9c0a57b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6da00cdaf0 tx=0x7f6da00d3b30 comp rx=0 tx=0).stop 2024-09-19T08:49:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 msgr2=0x7f6dac199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 0x7f6dac199ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6da000e9c0 tx=0x7f6da000ee80 comp rx=0 tx=0).stop 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 shutdown_connections 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f6d9c0a32f0 0x7f6d9c0a57b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dac1025f0 0x7f6dac1a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac101c30 0x7f6dac19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 --2- 172.21.15.18:0/4146826944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dac100a40 0x7f6dac199ea0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 >> 172.21.15.18:0/4146826944 conn(0x7f6dac0fc1e0 msgr2=0x7f6dac104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 shutdown_connections 2024-09-19T08:49:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:16.448+0000 7f6db2d8f640 1 -- 172.21.15.18:0/4146826944 wait complete. 2024-09-19T08:49:17.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:17 smithi150 ceph-mon[34610]: pgmap v469: 129 pgs: 129 active+clean; 44 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.5 MiB/s wr, 457 op/s 2024-09-19T08:49:17.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:17 smithi162 ceph-mon[34870]: pgmap v469: 129 pgs: 129 active+clean; 44 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.5 MiB/s wr, 457 op/s 2024-09-19T08:49:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:17 smithi018 ceph-mon[30956]: pgmap v469: 129 pgs: 129 active+clean; 44 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.5 MiB/s wr, 457 op/s 2024-09-19T08:49:19.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:19 smithi150 ceph-mon[34610]: pgmap v470: 129 pgs: 129 active+clean; 43 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.0 MiB/s wr, 401 op/s 2024-09-19T08:49:19.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:19 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:19.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:19 smithi162 ceph-mon[34870]: pgmap v470: 129 pgs: 129 active+clean; 43 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.0 MiB/s wr, 401 op/s 2024-09-19T08:49:19.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:19 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:19.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:19 smithi018 ceph-mon[30956]: pgmap v470: 129 pgs: 129 active+clean; 43 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.0 MiB/s wr, 401 op/s 2024-09-19T08:49:19.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:20.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:20.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:20.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:49:20.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:20.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:20.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:49:20.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:20.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:20.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:49:21.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:21 smithi150 ceph-mon[34610]: pgmap v471: 129 pgs: 129 active+clean; 42 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.7 MiB/s wr, 543 op/s 2024-09-19T08:49:21.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:21 smithi162 ceph-mon[34870]: pgmap v471: 129 pgs: 129 active+clean; 42 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.7 MiB/s wr, 543 op/s 2024-09-19T08:49:21.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:21 smithi018 ceph-mon[30956]: pgmap v471: 129 pgs: 129 active+clean; 42 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.7 MiB/s wr, 543 op/s 2024-09-19T08:49:22.877 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0x9ff7e4 2024-09-19T08:49:23.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:23 smithi150 ceph-mon[34610]: pgmap v472: 129 pgs: 129 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.5 MiB/s wr, 516 op/s 2024-09-19T08:49:23.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:23 smithi162 ceph-mon[34870]: pgmap v472: 129 pgs: 129 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.5 MiB/s wr, 516 op/s 2024-09-19T08:49:23.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:23 smithi018 ceph-mon[30956]: pgmap v472: 129 pgs: 129 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.5 MiB/s wr, 516 op/s 2024-09-19T08:49:24.530 INFO:tasks.workunit.client.0.smithi018.stdout:10000 write 0x723fbd thru 0x733aaa (0xfaee bytes) 2024-09-19T08:49:25.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:25 smithi150 ceph-mon[34610]: pgmap v473: 129 pgs: 129 active+clean; 38 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 586 op/s 2024-09-19T08:49:25.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:25 smithi162 ceph-mon[34870]: pgmap v473: 129 pgs: 129 active+clean; 38 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 586 op/s 2024-09-19T08:49:25.430 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0xa00000 2024-09-19T08:49:25.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:25 smithi018 ceph-mon[30956]: pgmap v473: 129 pgs: 129 active+clean; 38 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 586 op/s 2024-09-19T08:49:27.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:27 smithi150 ceph-mon[34610]: pgmap v474: 129 pgs: 129 active+clean; 40 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 609 op/s 2024-09-19T08:49:27.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:27 smithi162 ceph-mon[34870]: pgmap v474: 129 pgs: 129 active+clean; 40 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 609 op/s 2024-09-19T08:49:27.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:27 smithi018 ceph-mon[30956]: pgmap v474: 129 pgs: 129 active+clean; 40 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 609 op/s 2024-09-19T08:49:29.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:29 smithi150 ceph-mon[34610]: pgmap v475: 129 pgs: 129 active+clean; 43 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 591 op/s 2024-09-19T08:49:29.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:29 smithi162 ceph-mon[34870]: pgmap v475: 129 pgs: 129 active+clean; 43 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 591 op/s 2024-09-19T08:49:29.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:29 smithi018 ceph-mon[30956]: pgmap v475: 129 pgs: 129 active+clean; 43 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 591 op/s 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 -- 172.21.15.18:0/1443186542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164101a40 msgr2=0x7f1164101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 --2- 172.21.15.18:0/1443186542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164101a40 0x7f1164101ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1158009900 tx=0x7f115802a410 comp rx=0 tx=0).stop 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 -- 172.21.15.18:0/1443186542 shutdown_connections 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 --2- 172.21.15.18:0/1443186542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164102400 0x7f116406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 --2- 172.21.15.18:0/1443186542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164101a40 0x7f1164101ec0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 --2- 172.21.15.18:0/1443186542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1164100850 0x7f1164100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 -- 172.21.15.18:0/1443186542 >> 172.21.15.18:0/1443186542 conn(0x7f11640fbfb0 msgr2=0x7f11640fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 -- 172.21.15.18:0/1443186542 shutdown_connections 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.564+0000 7f116359e640 1 -- 172.21.15.18:0/1443186542 wait complete. 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 Processor -- start 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 -- start start 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 0x7f116419dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1164101a40 0x7f116419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164102400 0x7f11641a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f116410b300 con 0x7f1164101a40 2024-09-19T08:49:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f116410b180 con 0x7f1164102400 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f116410b480 con 0x7f1164100850 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 0x7f116419dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f1161d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1164101a40 0x7f116419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 0x7f116419dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:38022/0 (socket says 172.21.15.18:38022) 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.565+0000 7f116259c640 1 -- 172.21.15.18:0/3268070513 learned_addr learned my addr 172.21.15.18:0/3268070513 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f1162d9d640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164102400 0x7f11641a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f116259c640 1 -- 172.21.15.18:0/3268070513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164102400 msgr2=0x7f11641a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f116259c640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164102400 0x7f11641a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f116259c640 1 -- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1164101a40 msgr2=0x7f116419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f116259c640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1164101a40 0x7f116419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f116259c640 1 -- 172.21.15.18:0/3268070513 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11641a5be0 con 0x7f1164100850 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.566+0000 7f116259c640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 0x7f116419dfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f115400bea0 tx=0x7f115400bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.567+0000 7f11537fe640 1 -- 172.21.15.18:0/3268070513 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115401a020 con 0x7f1164100850 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.567+0000 7f11537fe640 1 -- 172.21.15.18:0/3268070513 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1154009e50 con 0x7f1164100850 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.567+0000 7f11537fe640 1 -- 172.21.15.18:0/3268070513 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154003ab0 con 0x7f1164100850 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.567+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11641909e0 con 0x7f1164100850 2024-09-19T08:49:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.567+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1164190e80 con 0x7f1164100850 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.569+0000 7f11537fe640 1 -- 172.21.15.18:0/3268070513 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f115400db10 con 0x7f1164100850 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.570+0000 7f11537fe640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f114c0a32c0 0x7f114c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.570+0000 7f11537fe640 1 -- 172.21.15.18:0/3268070513 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f11540cf5a0 con 0x7f1164100850 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.570+0000 7f1161d9b640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f114c0a32c0 0x7f114c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.570+0000 7f116be6f740 1 Processor -- start 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.570+0000 7f116be6f740 1 -- start start 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116be6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b478df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116be6f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b4792f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116be6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b4795a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116be6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5604b46f12f0 con 0x5604b4793540 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116be6f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5604b4699270 con 0x5604b478e4b0 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116be6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5604b46ed2b0 con 0x5604b478db70 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b4795a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1161d9b640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f114c0a32c0 0x7f114c0a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f116419f4d0 tx=0x7f1158000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1161d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b4792f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b4795a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38134/0 (socket says 172.21.15.18:38134) 2024-09-19T08:49:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 -- 172.21.15.18:0/2762993823 learned_addr learned my addr 172.21.15.18:0/2762993823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f116259c640 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b478df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 -- 172.21.15.18:0/2762993823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 msgr2=0x5604b478df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b478df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 -- 172.21.15.18:0/2762993823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 msgr2=0x5604b4792f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b4792f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.571+0000 7f1162d9d640 1 -- 172.21.15.18:0/2762993823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b4698340 con 0x5604b4793540 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.572+0000 7f116259c640 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b478df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.572+0000 7f1161d9b640 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b4792f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.572+0000 7f1162d9d640 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b4795a00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f115c009fd0 tx=0x7f115c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a6900afbddfe5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.572+0000 7f1150ff9640 1 -- 172.21.15.18:0/2762993823 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c004d20 con 0x5604b4793540 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.572+0000 7f1150ff9640 1 -- 172.21.15.18:0/2762993823 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f115c004050 con 0x5604b4793540 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.572+0000 7f1150ff9640 1 -- 172.21.15.18:0/2762993823 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c005280 con 0x5604b4793540 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 -- 172.21.15.18:0/2762993823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 msgr2=0x5604b4795a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b4795a00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f115c009fd0 tx=0x7f115c0118d0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 -- 172.21.15.18:0/2762993823 shutdown_connections 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b4795a00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b4792f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762993823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b478df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 -- 172.21.15.18:0/2762993823 >> 172.21.15.18:0/2762993823 conn(0x5604b47891e0 msgr2=0x5604b47895e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 -- 172.21.15.18:0/2762993823 shutdown_connections 2024-09-19T08:49:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 -- 172.21.15.18:0/2762993823 wait complete. 2024-09-19T08:49:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 -- start start 2024-09-19T08:49:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.573+0000 7f116be6f740 1 Processor -- start 2024-09-19T08:49:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b4797d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b47982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b479f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5604b4796510 con 0x5604b4793540 2024-09-19T08:49:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5604b467a290 con 0x5604b478e4b0 2024-09-19T08:49:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5604b4796690 con 0x5604b478db70 2024-09-19T08:49:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b47982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b47982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:32804/0 (socket says 172.21.15.18:32804) 2024-09-19T08:49:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 -- 172.21.15.18:0/1868299267 learned_addr learned my addr 172.21.15.18:0/1868299267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116be6f740 10 client.0 _ll_register_callbacks cb 0x5604b46ab140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1162d9d640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b479f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f116259c640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b4797d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 -- 172.21.15.18:0/1868299267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 msgr2=0x5604b4797d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b4797d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 -- 172.21.15.18:0/1868299267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 msgr2=0x5604b479f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b479f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 -- 172.21.15.18:0/1868299267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b4404210 con 0x5604b478e4b0 2024-09-19T08:49:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1162d9d640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b479f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1161d9b640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b47982d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f115802aa00 tx=0x7f1158005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29cffd4604bab66c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1149ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:49:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.574+0000 7f1149ffb640 1 -- 172.21.15.18:0/1868299267 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158035040 con 0x5604b478e4b0 2024-09-19T08:49:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115c004050 con 0x5604b478e4b0 2024-09-19T08:49:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f1149ffb640 1 -- 172.21.15.18:0/1868299267 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1158004bb0 con 0x5604b478e4b0 2024-09-19T08:49:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f1149ffb640 1 -- 172.21.15.18:0/1868299267 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f115806c050 con 0x5604b478e4b0 2024-09-19T08:49:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 10 client.25124 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5604b44d0620 con 0x5604b478e4b0 2024-09-19T08:49:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f1149ffb640 1 -- 172.21.15.18:0/1868299267 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f115c004050 con 0x5604b478e4b0 2024-09-19T08:49:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f1149ffb640 1 -- 172.21.15.18:0/1868299267 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f115804a040 con 0x5604b478e4b0 2024-09-19T08:49:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 10 client.25124 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 10 client.25124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 20 client.25124 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b47a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 4 client.25124 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b46fea20 con 0x5604b47a3a00 2024-09-19T08:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.575+0000 7f116259c640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b47a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.576+0000 7f1149ffb640 10 client.25124 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.576+0000 7f116259c640 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b47a5df0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ba6c9d9b7b5435 server_cookie=7153802efcbcd713 in_seq=0 out_seq=0 2024-09-19T08:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f1149ffb640 1 -- 172.21.15.18:0/1868299267 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604b46fea20 con 0x5604b47a3a00 2024-09-19T08:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f1149ffb640 10 client.25124 handle_command_reply: tid=0 2024-09-19T08:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 client.25124 shutdown 2024-09-19T08:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 msgr2=0x5604b47982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b47982d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f115802aa00 tx=0x7f1158005fd0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 shutdown_connections 2024-09-19T08:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b47a5df0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b4793540 0x5604b479f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f1149ffb640 0 client.25124 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b47982d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 --2- 172.21.15.18:0/1868299267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478db70 0x5604b4797d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 >> 172.21.15.18:0/1868299267 conn(0x5604b47891e0 msgr2=0x5604b478a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 shutdown_connections 2024-09-19T08:49:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 1 -- 172.21.15.18:0/1868299267 wait complete. 2024-09-19T08:49:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.577+0000 7f116be6f740 20 client.25124 trim_cache size 0 max 16384 2024-09-19T08:49:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.600+0000 7f116be6f740 1 Processor -- start 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.600+0000 7f116be6f740 1 -- start start 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.600+0000 7f116be6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b4787a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.600+0000 7f116be6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478e4b0 0x5604b479f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116be6f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b4793540 0x5604b4787fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116be6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1164198e40 con 0x5604b478db70 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116be6f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f11641a8c00 con 0x5604b4793540 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116be6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11641a69f0 con 0x5604b478e4b0 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b4787a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b4787a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38152/0 (socket says 172.21.15.18:38152) 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116259c640 1 -- 172.21.15.18:0/2762997274 learned_addr learned my addr 172.21.15.18:0/2762997274 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1162d9d640 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b4793540 0x5604b4787fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1161d9b640 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478e4b0 0x5604b479f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1161d9b640 1 -- 172.21.15.18:0/2762997274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b4793540 msgr2=0x5604b4787fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1161d9b640 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b4793540 0x5604b4787fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1161d9b640 1 -- 172.21.15.18:0/2762997274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 msgr2=0x5604b4787a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1161d9b640 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b4787a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f1161d9b640 1 -- 172.21.15.18:0/2762997274 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b4795d70 con 0x5604b478e4b0 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.601+0000 7f116259c640 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b4787a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.602+0000 7f1161d9b640 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478e4b0 0x5604b479f2d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11580318e0 tx=0x7f1158005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fe121474b304cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.602+0000 7f114bfff640 1 -- 172.21.15.18:0/2762997274 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158075070 con 0x5604b478e4b0 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.602+0000 7f114bfff640 1 -- 172.21.15.18:0/2762997274 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1158031b60 con 0x5604b478e4b0 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.602+0000 7f114bfff640 1 -- 172.21.15.18:0/2762997274 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158035040 con 0x5604b478e4b0 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.602+0000 7f116be6f740 1 -- 172.21.15.18:0/2762997274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478e4b0 msgr2=0x5604b479f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.602+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478e4b0 0x5604b479f2d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11580318e0 tx=0x7f1158005250 comp rx=0 tx=0).stop 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- 172.21.15.18:0/2762997274 shutdown_connections 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b4793540 0x5604b4787fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b478e4b0 0x5604b479f2d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 --2- 172.21.15.18:0/2762997274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b4787a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- 172.21.15.18:0/2762997274 >> 172.21.15.18:0/2762997274 conn(0x5604b47891e0 msgr2=0x5604b478f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- 172.21.15.18:0/2762997274 shutdown_connections 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- 172.21.15.18:0/2762997274 wait complete. 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- start start 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 Processor -- start 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b479c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b479cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b4793540 0x5604b479dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11641a70c0 con 0x5604b478db70 2024-09-19T08:49:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f11641a8530 con 0x5604b478e4b0 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.603+0000 7f116be6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11641a7790 con 0x5604b4793540 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b479cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f116259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b479c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b479cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:32822/0 (socket says 172.21.15.18:32822) 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f116be6f740 10 client.0 _ll_register_callbacks cb 0x7f115c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 -- 172.21.15.18:0/1956650894 learned_addr learned my addr 172.21.15.18:0/1956650894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f116259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b479c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38156/0 (socket says 172.21.15.18:38156) 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1162d9d640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b4793540 0x5604b479dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 -- 172.21.15.18:0/1956650894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b4793540 msgr2=0x5604b479dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b4793540 0x5604b479dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 -- 172.21.15.18:0/1956650894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 msgr2=0x5604b479c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b479c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 -- 172.21.15.18:0/1956650894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b479e270 con 0x5604b478e4b0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1162d9d640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b4793540 0x5604b479dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1161d9b640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b479cca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f115802a9d0 tx=0x7f1158004f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf64e8ff56b711 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1149ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1149ffb640 1 -- 172.21.15.18:0/1956650894 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158075070 con 0x5604b478e4b0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.604+0000 7f1149ffb640 1 -- 172.21.15.18:0/1956650894 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1158003b30 con 0x5604b478e4b0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1158031b60 con 0x5604b478e4b0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f1149ffb640 1 -- 172.21.15.18:0/1956650894 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1158084050 con 0x5604b478e4b0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 10 client.25130 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5604b479f580 con 0x5604b478e4b0 2024-09-19T08:49:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f1149ffb640 1 -- 172.21.15.18:0/1956650894 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1158031b60 con 0x5604b478e4b0 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f1149ffb640 1 -- 172.21.15.18:0/1956650894 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f115806f030 con 0x5604b478e4b0 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 10 client.25130 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 10 client.25130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 20 client.25130 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b4810d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 4 client.25130 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.605+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604b46f8d70 con 0x5604b47a3a00 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.606+0000 7f116259c640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b4810d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.606+0000 7f1149ffb640 10 client.25130 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:29.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.606+0000 7f116259c640 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b4810d20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c5db32825de0a2 server_cookie=f2ecaa7d53ab4c18 in_seq=0 out_seq=0 2024-09-19T08:49:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.622+0000 7f1149ffb640 1 -- 172.21.15.18:0/1956650894 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604b46f8d70 con 0x5604b47a3a00 2024-09-19T08:49:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.622+0000 7f1149ffb640 10 client.25130 handle_command_reply: tid=0 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 client.25130 shutdown 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 msgr2=0x5604b479cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b479cca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f115802a9d0 tx=0x7f1158004f50 comp rx=0 tx=0).stop 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 shutdown_connections 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5604b47a3a00 0x5604b4810d20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5604b4793540 0x5604b479dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604b478e4b0 0x5604b479cca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 --2- 172.21.15.18:0/1956650894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b478db70 0x5604b479c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 >> 172.21.15.18:0/1956650894 conn(0x5604b47891e0 msgr2=0x5604b478a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f1149ffb640 0 client.25130 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 shutdown_connections 2024-09-19T08:49:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.623+0000 7f116be6f740 1 -- 172.21.15.18:0/1956650894 wait complete. 2024-09-19T08:49:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.624+0000 7f116be6f740 20 client.25130 trim_cache size 0 max 16384 2024-09-19T08:49:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:49:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:49:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:49:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f114c0a32c0 msgr2=0x7f114c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f114c0a32c0 0x7f114c0a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f116419f4d0 tx=0x7f1158000bc0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 msgr2=0x7f116419dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 0x7f116419dfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f115400bea0 tx=0x7f115400bf90 comp rx=0 tx=0).stop 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 shutdown_connections 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f114c0a32c0 0x7f114c0a5780 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1164102400 0x7f11641a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1164101a40 0x7f116419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 --2- 172.21.15.18:0/3268070513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1164100850 0x7f116419dfc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.625+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 >> 172.21.15.18:0/3268070513 conn(0x7f11640fbfb0 msgr2=0x7f1164102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.626+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 shutdown_connections 2024-09-19T08:49:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:29.626+0000 7f116359e640 1 -- 172.21.15.18:0/3268070513 wait complete. 2024-09-19T08:49:31.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:31 smithi150 ceph-mon[34610]: pgmap v476: 129 pgs: 129 active+clean; 41 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 635 op/s 2024-09-19T08:49:31.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:31 smithi162 ceph-mon[34870]: pgmap v476: 129 pgs: 129 active+clean; 41 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 635 op/s 2024-09-19T08:49:31.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:31 smithi018 ceph-mon[30956]: pgmap v476: 129 pgs: 129 active+clean; 41 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 635 op/s 2024-09-19T08:49:33.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:33 smithi150 ceph-mon[34610]: pgmap v477: 129 pgs: 129 active+clean; 36 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.3 MiB/s wr, 606 op/s 2024-09-19T08:49:33.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:33 smithi162 ceph-mon[34870]: pgmap v477: 129 pgs: 129 active+clean; 36 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.3 MiB/s wr, 606 op/s 2024-09-19T08:49:33.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:33 smithi018 ceph-mon[30956]: pgmap v477: 129 pgs: 129 active+clean; 36 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.3 MiB/s wr, 606 op/s 2024-09-19T08:49:35.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:35 smithi162 ceph-mon[34870]: pgmap v478: 129 pgs: 129 active+clean; 35 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 577 op/s 2024-09-19T08:49:35.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:35 smithi018 ceph-mon[30956]: pgmap v478: 129 pgs: 129 active+clean; 35 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 577 op/s 2024-09-19T08:49:35.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:35 smithi150 ceph-mon[34610]: pgmap v478: 129 pgs: 129 active+clean; 35 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 577 op/s 2024-09-19T08:49:37.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:37 smithi162 ceph-mon[34870]: pgmap v479: 129 pgs: 129 active+clean; 37 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.7 MiB/s wr, 564 op/s 2024-09-19T08:49:37.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:37 smithi018 ceph-mon[30956]: pgmap v479: 129 pgs: 129 active+clean; 37 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.7 MiB/s wr, 564 op/s 2024-09-19T08:49:37.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:37 smithi150 ceph-mon[34610]: pgmap v479: 129 pgs: 129 active+clean; 37 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.7 MiB/s wr, 564 op/s 2024-09-19T08:49:39.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:39 smithi162 ceph-mon[34870]: pgmap v480: 129 pgs: 129 active+clean; 40 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 554 op/s 2024-09-19T08:49:39.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:39 smithi018 ceph-mon[30956]: pgmap v480: 129 pgs: 129 active+clean; 40 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 554 op/s 2024-09-19T08:49:39.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:39 smithi150 ceph-mon[34610]: pgmap v480: 129 pgs: 129 active+clean; 40 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 554 op/s 2024-09-19T08:49:40.149 INFO:tasks.workunit.client.0.smithi018.stdout:20000 mapread 0x1c4208 thru 0x1c56d4 (0x14cd bytes) 2024-09-19T08:49:41.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:41 smithi162 ceph-mon[34870]: pgmap v481: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 598 op/s 2024-09-19T08:49:41.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:41 smithi018 ceph-mon[30956]: pgmap v481: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 598 op/s 2024-09-19T08:49:41.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:41 smithi150 ceph-mon[34610]: pgmap v481: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 598 op/s 2024-09-19T08:49:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3028448679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4100a40 msgr2=0x7fc1e4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3028448679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4100a40 0x7fc1e4100e40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009900 tx=0x7fc1e002a410 comp rx=0 tx=0).stop 2024-09-19T08:49:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3028448679 shutdown_connections 2024-09-19T08:49:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3028448679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e41025f0 0x7fc1e4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3028448679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4101c30 0x7fc1e41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3028448679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4100a40 0x7fc1e4100e40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.737+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3028448679 >> 172.21.15.18:0/3028448679 conn(0x7fc1e40fc1e0 msgr2=0x7fc1e40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.738+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3028448679 shutdown_connections 2024-09-19T08:49:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.738+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3028448679 wait complete. 2024-09-19T08:49:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 Processor -- start 2024-09-19T08:49:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 -- start start 2024-09-19T08:49:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 0x7fc1e4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4101c30 0x7fc1e4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e41025f0 0x7fc1e419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410c5c0 con 0x7fc1e4101c30 2024-09-19T08:49:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410c440 con 0x7fc1e41025f0 2024-09-19T08:49:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1eb7d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410c740 con 0x7fc1e4100a40 2024-09-19T08:49:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1e9574640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 0x7fc1e4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1e9574640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 0x7fc1e4197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53644/0 (socket says 172.21.15.18:53644) 2024-09-19T08:49:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1e9574640 1 -- 172.21.15.18:0/3393242767 learned_addr learned my addr 172.21.15.18:0/3393242767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.739+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4101c30 0x7fc1e4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.740+0000 7fc1e9574640 1 -- 172.21.15.18:0/3393242767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e41025f0 msgr2=0x7fc1e419f2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:49:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.740+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e41025f0 0x7fc1e419f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.740+0000 7fc1e9574640 1 -- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4101c30 msgr2=0x7fc1e4198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.740+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4101c30 0x7fc1e4198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.740+0000 7fc1e9574640 1 -- 172.21.15.18:0/3393242767 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e419f960 con 0x7fc1e4100a40 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.740+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 0x7fc1e4197d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00314e0 tx=0x7fc1e0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.741+0000 7fc1da7fc640 1 -- 172.21.15.18:0/3393242767 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e003f070 con 0x7fc1e4100a40 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.741+0000 7fc1da7fc640 1 -- 172.21.15.18:0/3393242767 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1e0031c30 con 0x7fc1e4100a40 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.741+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e4102e50 con 0x7fc1e4100a40 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.741+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e4103340 con 0x7fc1e4100a40 2024-09-19T08:49:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.741+0000 7fc1da7fc640 1 -- 172.21.15.18:0/3393242767 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0035030 con 0x7fc1e4100a40 2024-09-19T08:49:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.744+0000 7fc1da7fc640 1 -- 172.21.15.18:0/3393242767 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc1e0042070 con 0x7fc1e4100a40 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.744+0000 7fc1ee64d740 1 Processor -- start 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.744+0000 7fc1ee64d740 1 -- start start 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05948da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059492e0 0x55bc0594dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05950830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bc058ac2f0 con 0x55bc0594e370 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bc05854270 con 0x55bc059489a0 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc058a82b0 con 0x55bc059492e0 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05948da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9574640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059492e0 0x55bc0594dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05948da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:56194/0 (socket says 172.21.15.18:56194) 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9d75640 1 -- 172.21.15.18:0/2946388259 learned_addr learned my addr 172.21.15.18:0/2946388259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1da7fc640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc1d00a34b0 0x7fc1d00a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05950830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9574640 1 -- 172.21.15.18:0/2946388259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 msgr2=0x55bc05948da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc1d00a34b0 0x7fc1d00a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9574640 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05948da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9574640 1 -- 172.21.15.18:0/2946388259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 msgr2=0x55bc05950830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9574640 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05950830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.745+0000 7fc1e9574640 1 -- 172.21.15.18:0/2946388259 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc05853340 con 0x55bc059492e0 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.746+0000 7fc1e9574640 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059492e0 0x55bc0594dda0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00edab0 tx=0x7fc1e0090480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba698fc8e71a3781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.746+0000 7fc1cf7fe640 1 -- 172.21.15.18:0/2946388259 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00b8040 con 0x55bc059492e0 2024-09-19T08:49:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.746+0000 7fc1cf7fe640 1 -- 172.21.15.18:0/2946388259 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1e00bcd00 con 0x55bc059492e0 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.746+0000 7fc1cf7fe640 1 -- 172.21.15.18:0/2946388259 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e008f870 con 0x55bc059492e0 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.746+0000 7fc1da7fc640 1 -- 172.21.15.18:0/3393242767 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc1e00f03b0 con 0x7fc1e4100a40 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 -- 172.21.15.18:0/2946388259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059492e0 msgr2=0x55bc0594dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc1d00a34b0 0x7fc1d00a5970 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009fd0 tx=0x7fc1dc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059492e0 0x55bc0594dda0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00edab0 tx=0x7fc1e0090480 comp rx=0 tx=0).stop 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 -- 172.21.15.18:0/2946388259 shutdown_connections 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05950830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059492e0 0x55bc0594dda0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/2946388259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05948da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 -- 172.21.15.18:0/2946388259 >> 172.21.15.18:0/2946388259 conn(0x55bc05944010 msgr2=0x55bc05944410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 -- 172.21.15.18:0/2946388259 shutdown_connections 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 -- 172.21.15.18:0/2946388259 wait complete. 2024-09-19T08:49:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 -- start start 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.747+0000 7fc1ee64d740 1 Processor -- start 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05952d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05959d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bc05951100 con 0x55bc059492e0 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bc05835290 con 0x55bc059489a0 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc05951280 con 0x55bc0594e370 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ee64d740 10 client.0 _ll_register_callbacks cb 0x55bc05866140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e8d73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05952d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05959d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05959d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53662/0 (socket says 172.21.15.18:53662) 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 -- 172.21.15.18:0/3572710263 learned_addr learned my addr 172.21.15.18:0/3572710263 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05952d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34892/0 (socket says 172.21.15.18:34892) 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 -- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 msgr2=0x55bc059527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 -- 172.21.15.18:0/3572710263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 msgr2=0x55bc05952d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05952d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 -- 172.21.15.18:0/3572710263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc055bf210 con 0x55bc0594e370 2024-09-19T08:49:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05959d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e60 tx=0x7fc1dc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488b553c44e6af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.748+0000 7fc1ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:49:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3572710263 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc024020 con 0x55bc0594e370 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3572710263 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc1dc020820 con 0x55bc0594e370 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e00bcd00 con 0x55bc0594e370 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3572710263 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc02f050 con 0x55bc0594e370 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 10 client.25222 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bc0568b620 con 0x55bc0594e370 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3572710263 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1e00bcd00 con 0x55bc0594e370 2024-09-19T08:49:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3572710263 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc1dc011970 con 0x55bc0594e370 2024-09-19T08:49:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 10 client.25222 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 10 client.25222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 20 client.25222 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc0595e560 0x55bc05960950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 4 client.25222 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.749+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc058b9a20 con 0x55bc0595e560 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.750+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc0595e560 0x55bc05960950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.750+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc0595e560 0x55bc05960950 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=109075de3612fed0 server_cookie=e85fa34d1c395bc0 in_seq=0 out_seq=0 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.750+0000 7fc1ccff9640 10 client.25222 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3572710263 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc058b9a20 con 0x55bc0595e560 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ccff9640 10 client.25222 handle_command_reply: tid=0 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 client.25222 shutdown 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 msgr2=0x55bc05959d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05959d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e60 tx=0x7fc1dc004ab0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 shutdown_connections 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc0595e560 0x55bc05960950 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05959d50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05952d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3572710263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ccff9640 0 client.25222 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 >> 172.21.15.18:0/3572710263 conn(0x55bc05944010 msgr2=0x55bc05945820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 shutdown_connections 2024-09-19T08:49:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3572710263 wait complete. 2024-09-19T08:49:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.751+0000 7fc1ee64d740 20 client.25222 trim_cache size 0 max 16384 2024-09-19T08:49:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 Processor -- start 2024-09-19T08:49:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 -- start start 2024-09-19T08:49:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059492e0 0x55bc05959d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05952d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a64c0 con 0x55bc0594e370 2024-09-19T08:49:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a8d40 con 0x55bc059492e0 2024-09-19T08:49:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a6b30 con 0x55bc059489a0 2024-09-19T08:49:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05952d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05952d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34898/0 (socket says 172.21.15.18:34898) 2024-09-19T08:49:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1e8d73640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059492e0 0x55bc05959d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1e9574640 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.771+0000 7fc1e9d75640 1 -- 172.21.15.18:0/631213627 learned_addr learned my addr 172.21.15.18:0/631213627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9d75640 1 -- 172.21.15.18:0/631213627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059489a0 msgr2=0x55bc059527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9d75640 1 -- 172.21.15.18:0/631213627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059492e0 msgr2=0x55bc05959d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059492e0 0x55bc05959d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9d75640 1 -- 172.21.15.18:0/631213627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc05960cc0 con 0x55bc0594e370 2024-09-19T08:49:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9574640 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059492e0 0x55bc05959d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05952d10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc011d90 tx=0x7fc1dc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662d576fbcdb05c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1ceffd640 1 -- 172.21.15.18:0/631213627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc024070 con 0x55bc0594e370 2024-09-19T08:49:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1ceffd640 1 -- 172.21.15.18:0/631213627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1dc019040 con 0x55bc0594e370 2024-09-19T08:49:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.772+0000 7fc1ceffd640 1 -- 172.21.15.18:0/631213627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc018070 con 0x55bc0594e370 2024-09-19T08:49:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 -- 172.21.15.18:0/631213627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 msgr2=0x55bc05952d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05952d10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc011d90 tx=0x7fc1dc005bd0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 -- 172.21.15.18:0/631213627 shutdown_connections 2024-09-19T08:49:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0594e370 0x55bc05952d10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059492e0 0x55bc05959d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/631213627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc059489a0 0x55bc059527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 -- 172.21.15.18:0/631213627 >> 172.21.15.18:0/631213627 conn(0x55bc05944010 msgr2=0x55bc05951570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 -- 172.21.15.18:0/631213627 shutdown_connections 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 -- 172.21.15.18:0/631213627 wait complete. 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.773+0000 7fc1ee64d740 1 -- start start 2024-09-19T08:49:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 Processor -- start 2024-09-19T08:49:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05957110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05957650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05958660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a7200 con 0x55bc059492e0 2024-09-19T08:49:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a8670 con 0x55bc059489a0 2024-09-19T08:49:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a78d0 con 0x55bc0594e370 2024-09-19T08:49:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1ee64d740 10 client.0 _ll_register_callbacks cb 0x7fc1dc010ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1e9574640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05957110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1e9574640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05957110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:56220/0 (socket says 172.21.15.18:56220) 2024-09-19T08:49:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1e9574640 1 -- 172.21.15.18:0/3584473823 learned_addr learned my addr 172.21.15.18:0/3584473823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1e9d75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05958660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05957650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.774+0000 7fc1e9574640 1 -- 172.21.15.18:0/3584473823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 msgr2=0x55bc05958660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05958660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1e9574640 1 -- 172.21.15.18:0/3584473823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 msgr2=0x55bc05957650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05957650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1e9574640 1 -- 172.21.15.18:0/3584473823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc05958c70 con 0x55bc059489a0 2024-09-19T08:49:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1e9d75640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05958660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1e9574640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05957110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0000c00 tx=0x7fc1e00b82a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e247a2f212e155 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:49:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3584473823 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e008e8b0 con 0x55bc059489a0 2024-09-19T08:49:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3584473823 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc1e00ba900 con 0x55bc059489a0 2024-09-19T08:49:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.775+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1dc019040 con 0x55bc059489a0 2024-09-19T08:49:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3584473823 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1e008ead0 con 0x55bc059489a0 2024-09-19T08:49:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 10 client.25145 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bc05959fe0 con 0x55bc059489a0 2024-09-19T08:49:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3584473823 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1dc019040 con 0x55bc059489a0 2024-09-19T08:49:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3584473823 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc1e00b8c70 con 0x55bc059489a0 2024-09-19T08:49:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 10 client.25145 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 10 client.25145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 20 client.25145 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc059c95b0 0x55bc059cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 4 client.25145 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:49:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc058b3d70 con 0x55bc059c95b0 2024-09-19T08:49:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.776+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc059c95b0 0x55bc059cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.777+0000 7fc1ccff9640 10 client.25145 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.777+0000 7fc1e8d73640 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc059c95b0 0x55bc059cb9d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c99a860e59474954 server_cookie=c6e879e475968612 in_seq=0 out_seq=0 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ccff9640 1 -- 172.21.15.18:0/3584473823 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc058b3d70 con 0x55bc059c95b0 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ccff9640 10 client.25145 handle_command_reply: tid=0 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 client.25145 shutdown 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 msgr2=0x55bc05957110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05957110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0000c00 tx=0x7fc1e00b82a0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 shutdown_connections 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55bc059c95b0 0x55bc059cb9d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc0594e370 0x55bc05958660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ccff9640 0 client.25145 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc059492e0 0x55bc05957650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 --2- 172.21.15.18:0/3584473823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc059489a0 0x55bc05957110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 >> 172.21.15.18:0/3584473823 conn(0x55bc05944010 msgr2=0x55bc05951570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 shutdown_connections 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 1 -- 172.21.15.18:0/3584473823 wait complete. 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.797+0000 7fc1ee64d740 20 client.25145 trim_cache size 0 max 16384 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:49:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:49:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc1d00a34b0 msgr2=0x7fc1d00a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc1d00a34b0 0x7fc1d00a5970 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009fd0 tx=0x7fc1dc004a40 comp rx=0 tx=0).stop 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 msgr2=0x7fc1e4197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 0x7fc1e4197d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00314e0 tx=0x7fc1e0003b90 comp rx=0 tx=0).stop 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 shutdown_connections 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fc1d00a34b0 0x7fc1d00a5970 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e41025f0 0x7fc1e419f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4101c30 0x7fc1e4198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 --2- 172.21.15.18:0/3393242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1e4100a40 0x7fc1e4197d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 >> 172.21.15.18:0/3393242767 conn(0x7fc1e40fc1e0 msgr2=0x7fc1e40fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 shutdown_connections 2024-09-19T08:49:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:42.798+0000 7fc1eb7d8640 1 -- 172.21.15.18:0/3393242767 wait complete. 2024-09-19T08:49:43.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:43 smithi162 ceph-mon[34870]: pgmap v482: 129 pgs: 129 active+clean; 38 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 565 op/s 2024-09-19T08:49:43.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:43 smithi018 ceph-mon[30956]: pgmap v482: 129 pgs: 129 active+clean; 38 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 565 op/s 2024-09-19T08:49:43.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:43 smithi150 ceph-mon[34610]: pgmap v482: 129 pgs: 129 active+clean; 38 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 565 op/s 2024-09-19T08:49:45.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:45 smithi162 ceph-mon[34870]: pgmap v483: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 534 op/s 2024-09-19T08:49:45.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:45 smithi018 ceph-mon[30956]: pgmap v483: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 534 op/s 2024-09-19T08:49:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:45 smithi150 ceph-mon[34610]: pgmap v483: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 534 op/s 2024-09-19T08:49:47.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:47 smithi162 ceph-mon[34870]: pgmap v484: 129 pgs: 129 active+clean; 42 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.1 MiB/s wr, 518 op/s 2024-09-19T08:49:47.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:47 smithi018 ceph-mon[30956]: pgmap v484: 129 pgs: 129 active+clean; 42 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.1 MiB/s wr, 518 op/s 2024-09-19T08:49:47.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:47 smithi150 ceph-mon[34610]: pgmap v484: 129 pgs: 129 active+clean; 42 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.1 MiB/s wr, 518 op/s 2024-09-19T08:49:49.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:49 smithi162 ceph-mon[34870]: pgmap v485: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 514 op/s 2024-09-19T08:49:49.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:49 smithi018 ceph-mon[30956]: pgmap v485: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 514 op/s 2024-09-19T08:49:49.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:49 smithi150 ceph-mon[34610]: pgmap v485: 129 pgs: 129 active+clean; 41 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 514 op/s 2024-09-19T08:49:51.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:51 smithi162 ceph-mon[34870]: pgmap v486: 129 pgs: 129 active+clean; 40 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 549 op/s 2024-09-19T08:49:51.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:51 smithi018 ceph-mon[30956]: pgmap v486: 129 pgs: 129 active+clean; 40 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 549 op/s 2024-09-19T08:49:51.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:51 smithi150 ceph-mon[34610]: pgmap v486: 129 pgs: 129 active+clean; 40 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 549 op/s 2024-09-19T08:49:53.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:53 smithi162 ceph-mon[34870]: pgmap v487: 129 pgs: 129 active+clean; 45 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.7 MiB/s wr, 550 op/s 2024-09-19T08:49:53.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:53 smithi018 ceph-mon[30956]: pgmap v487: 129 pgs: 129 active+clean; 45 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.7 MiB/s wr, 550 op/s 2024-09-19T08:49:53.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:53 smithi150 ceph-mon[34610]: pgmap v487: 129 pgs: 129 active+clean; 45 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.7 MiB/s wr, 550 op/s 2024-09-19T08:49:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:55 smithi162 ceph-mon[34870]: pgmap v488: 129 pgs: 129 active+clean; 43 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 528 op/s 2024-09-19T08:49:55.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:55 smithi018 ceph-mon[30956]: pgmap v488: 129 pgs: 129 active+clean; 43 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 528 op/s 2024-09-19T08:49:55.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:55 smithi150 ceph-mon[34610]: pgmap v488: 129 pgs: 129 active+clean; 43 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 528 op/s 2024-09-19T08:49:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.917+0000 7ff158e65640 1 -- 172.21.15.18:0/2866646029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154102d50 msgr2=0x7ff1541031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.917+0000 7ff158e65640 1 --2- 172.21.15.18:0/2866646029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154102d50 0x7ff1541031d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff148009900 tx=0x7ff14802a410 comp rx=0 tx=0).stop 2024-09-19T08:49:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 -- 172.21.15.18:0/2866646029 shutdown_connections 2024-09-19T08:49:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 --2- 172.21.15.18:0/2866646029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff154103710 0x7ff154109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 --2- 172.21.15.18:0/2866646029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154102d50 0x7ff1541031d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 --2- 172.21.15.18:0/2866646029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154101b60 0x7ff154101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 -- 172.21.15.18:0/2866646029 >> 172.21.15.18:0/2866646029 conn(0x7ff1540fd2e0 msgr2=0x7ff1540ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 -- 172.21.15.18:0/2866646029 shutdown_connections 2024-09-19T08:49:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.918+0000 7ff158e65640 1 -- 172.21.15.18:0/2866646029 wait complete. 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 Processor -- start 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 -- start start 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154101b60 0x7ff154197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff154102d50 0x7ff154198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154103710 0x7ff15419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff15410d670 con 0x7ff154101b60 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff15410d4f0 con 0x7ff154102d50 2024-09-19T08:49:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff158e65640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff15410d7f0 con 0x7ff154103710 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff154102d50 0x7ff154198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff15259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154101b60 0x7ff154197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff152d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154103710 0x7ff15419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff15259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154101b60 0x7ff154197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40364/0 (socket says 172.21.15.18:40364) 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff15259c640 1 -- 172.21.15.18:0/1778171504 learned_addr learned my addr 172.21.15.18:0/1778171504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff152d9d640 1 -- 172.21.15.18:0/1778171504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff154102d50 msgr2=0x7ff154198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff154102d50 0x7ff154198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff152d9d640 1 -- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154101b60 msgr2=0x7ff154197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154101b60 0x7ff154197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.919+0000 7ff152d9d640 1 -- 172.21.15.18:0/1778171504 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15419f940 con 0x7ff154103710 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.920+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154103710 0x7ff15419f2a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00ec50 tx=0x7ff14c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.920+0000 7ff1437fe640 1 -- 172.21.15.18:0/1778171504 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c003b70 con 0x7ff154103710 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.920+0000 7ff1437fe640 1 -- 172.21.15.18:0/1778171504 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14c003d10 con 0x7ff154103710 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.920+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15419fc30 con 0x7ff154103710 2024-09-19T08:49:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.920+0000 7ff1437fe640 1 -- 172.21.15.18:0/1778171504 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c010760 con 0x7ff154103710 2024-09-19T08:49:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.920+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1541a0180 con 0x7ff154103710 2024-09-19T08:49:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.923+0000 7ff1437fe640 1 -- 172.21.15.18:0/1778171504 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff14c004000 con 0x7ff154103710 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.923+0000 7ff15bc02740 1 Processor -- start 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 -- start start 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8026da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff1437fe640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff13c0a32f0 0x7ff13c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd802bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd802e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558fd7f8a2f0 con 0x558fd802c370 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558fd7f32270 con 0x558fd80272e0 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15bc02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558fd7f862b0 con 0x558fd80269a0 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff152d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd802e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd802bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd802bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:34980/0 (socket says 172.21.15.18:34980) 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff151d9b640 1 -- 172.21.15.18:0/1180823628 learned_addr learned my addr 172.21.15.18:0/1180823628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff15259c640 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8026da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff151d9b640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff13c0a32f0 0x7ff13c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.924+0000 7ff1437fe640 1 -- 172.21.15.18:0/1778171504 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff14c0d02a0 con 0x7ff154103710 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff152d9d640 1 -- 172.21.15.18:0/1180823628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 msgr2=0x558fd8026da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8026da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff152d9d640 1 -- 172.21.15.18:0/1180823628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 msgr2=0x558fd802bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd802bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff152d9d640 1 -- 172.21.15.18:0/1180823628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd7f31340 con 0x558fd802c370 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff151d9b640 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd802bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd802e830 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0988c0 tx=0x7ff14c066ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f69d57bfcd6ee30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff151d9b640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff13c0a32f0 0x7ff13c0a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x558fd8027d10 tx=0x7ff148000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff140ff9640 1 -- 172.21.15.18:0/1180823628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c09be50 con 0x558fd802c370 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.925+0000 7ff140ff9640 1 -- 172.21.15.18:0/1180823628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14c009820 con 0x558fd802c370 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff140ff9640 1 -- 172.21.15.18:0/1180823628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c014ed0 con 0x558fd802c370 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 -- 172.21.15.18:0/1180823628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 msgr2=0x558fd802e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd802e830 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0988c0 tx=0x7ff14c066ea0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 -- 172.21.15.18:0/1180823628 shutdown_connections 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd802e830 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd802bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1180823628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8026da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.926+0000 7ff15bc02740 1 -- 172.21.15.18:0/1180823628 >> 172.21.15.18:0/1180823628 conn(0x558fd8022010 msgr2=0x558fd8022410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.927+0000 7ff15bc02740 1 -- 172.21.15.18:0/1180823628 shutdown_connections 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.927+0000 7ff15bc02740 1 -- 172.21.15.18:0/1180823628 wait complete. 2024-09-19T08:49:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.927+0000 7ff15bc02740 1 -- start start 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.927+0000 7ff15bc02740 1 Processor -- start 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.927+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80269a0 0x558fd8030ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.927+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80272e0 0x558fd80310e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 0x558fd8038120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff15bc02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558fd802f340 con 0x558fd80269a0 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff15bc02740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558fd7f13290 con 0x558fd802c370 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff15bc02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558fd802f4c0 con 0x558fd80272e0 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff15bc02740 10 client.0 _ll_register_callbacks cb 0x558fd7f44140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff152d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 0x558fd8038120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80272e0 0x558fd80310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff152d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 0x558fd8038120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:34982/0 (socket says 172.21.15.18:34982) 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff152d9d640 1 -- 172.21.15.18:0/3342275317 learned_addr learned my addr 172.21.15.18:0/3342275317 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff151d9b640 1 -- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 msgr2=0x558fd8038120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff151d9b640 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 0x558fd8038120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff151d9b640 1 -- 172.21.15.18:0/3342275317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80269a0 msgr2=0x558fd8030ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff151d9b640 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80269a0 0x558fd8030ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff151d9b640 1 -- 172.21.15.18:0/3342275317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd7c9d210 con 0x558fd80272e0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.928+0000 7ff152d9d640 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 0x558fd8038120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff151d9b640 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80272e0 0x558fd80310e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1480096c0 tx=0x7ff14802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d67a59a09b40c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff139ffb640 1 -- 172.21.15.18:0/3342275317 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148035040 con 0x558fd80272e0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff139ffb640 1 -- 172.21.15.18:0/3342275317 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff1480043d0 con 0x558fd80272e0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff14c009820 con 0x558fd80272e0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff139ffb640 1 -- 172.21.15.18:0/3342275317 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff1480035f0 con 0x558fd80272e0 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 10 client.25240 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558fd7d69620 con 0x558fd80272e0 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff139ffb640 1 -- 172.21.15.18:0/3342275317 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14c009820 con 0x558fd80272e0 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff139ffb640 1 -- 172.21.15.18:0/3342275317 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff14803b8b0 con 0x558fd80272e0 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 10 client.25240 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 10 client.25240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 20 client.25240 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd803c880 0x558fd803ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 4 client.25240 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.929+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fd7f97a20 con 0x558fd803c880 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.930+0000 7ff15259c640 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd803c880 0x558fd803ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.930+0000 7ff139ffb640 10 client.25240 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.930+0000 7ff15259c640 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd803c880 0x558fd803ecd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14aaea4d6f86247 server_cookie=192e815513a03d0d in_seq=0 out_seq=0 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.931+0000 7ff139ffb640 1 -- 172.21.15.18:0/3342275317 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fd7f97a20 con 0x558fd803c880 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.931+0000 7ff139ffb640 10 client.25240 handle_command_reply: tid=0 2024-09-19T08:49:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.931+0000 7ff15bc02740 1 client.25240 shutdown 2024-09-19T08:49:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80272e0 msgr2=0x558fd80310e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80272e0 0x558fd80310e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1480096c0 tx=0x7ff14802a410 comp rx=0 tx=0).stop 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 shutdown_connections 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd803c880 0x558fd803ecd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd802c370 0x558fd8038120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80272e0 0x558fd80310e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 --2- 172.21.15.18:0/3342275317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80269a0 0x558fd8030ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 >> 172.21.15.18:0/3342275317 conn(0x558fd8022010 msgr2=0x558fd8023820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff139ffb640 0 client.25240 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 shutdown_connections 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 1 -- 172.21.15.18:0/3342275317 wait complete. 2024-09-19T08:49:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.933+0000 7ff15bc02740 20 client.25240 trim_cache size 0 max 16384 2024-09-19T08:49:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.953+0000 7ff15bc02740 1 Processor -- start 2024-09-19T08:49:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.953+0000 7ff15bc02740 1 -- start start 2024-09-19T08:49:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8022ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd80380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd8023400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15bc02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541a8760 con 0x558fd802c370 2024-09-19T08:49:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15bc02740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541aafe0 con 0x558fd80272e0 2024-09-19T08:49:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15bc02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541a8dd0 con 0x558fd80269a0 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd80380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff15259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8022ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd80380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:34990/0 (socket says 172.21.15.18:34990) 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff151d9b640 1 -- 172.21.15.18:0/1072616219 learned_addr learned my addr 172.21.15.18:0/1072616219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.954+0000 7ff152d9d640 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd8023400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.955+0000 7ff15259c640 1 -- 172.21.15.18:0/1072616219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 msgr2=0x558fd80380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.955+0000 7ff15259c640 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd80380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.955+0000 7ff15259c640 1 -- 172.21.15.18:0/1072616219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 msgr2=0x558fd8023400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.955+0000 7ff15259c640 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd8023400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.955+0000 7ff15259c640 1 -- 172.21.15.18:0/1072616219 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd8027f70 con 0x558fd80269a0 2024-09-19T08:49:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.955+0000 7ff15259c640 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8022ec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x558fd80300d0 tx=0x7ff144004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c659f95760b698f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.956+0000 7ff13bfff640 1 -- 172.21.15.18:0/1072616219 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14401d420 con 0x558fd80269a0 2024-09-19T08:49:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.956+0000 7ff13bfff640 1 -- 172.21.15.18:0/1072616219 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14401da70 con 0x558fd80269a0 2024-09-19T08:49:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.956+0000 7ff13bfff640 1 -- 172.21.15.18:0/1072616219 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144010c00 con 0x558fd80269a0 2024-09-19T08:49:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.957+0000 7ff15bc02740 1 -- 172.21.15.18:0/1072616219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 msgr2=0x558fd8022ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.957+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8022ec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x558fd80300d0 tx=0x7ff144004580 comp rx=0 tx=0).stop 2024-09-19T08:49:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 -- 172.21.15.18:0/1072616219 shutdown_connections 2024-09-19T08:49:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd802c370 0x558fd8023400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80272e0 0x558fd80380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 --2- 172.21.15.18:0/1072616219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd80269a0 0x558fd8022ec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 -- 172.21.15.18:0/1072616219 >> 172.21.15.18:0/1072616219 conn(0x558fd8022010 msgr2=0x558fd8028480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 -- 172.21.15.18:0/1072616219 shutdown_connections 2024-09-19T08:49:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 -- 172.21.15.18:0/1072616219 wait complete. 2024-09-19T08:49:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 -- start start 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.959+0000 7ff15bc02740 1 Processor -- start 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80269a0 0x558fd80338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80272e0 0x558fd8033df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd802c370 0x558fd8036e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541a94a0 con 0x558fd80272e0 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541aa910 con 0x558fd80269a0 2024-09-19T08:49:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541a9b70 con 0x558fd802c370 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15bc02740 10 client.0 _ll_register_callbacks cb 0x7ff144005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80272e0 0x558fd8033df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff151d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80272e0 0x558fd8033df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40396/0 (socket says 172.21.15.18:40396) 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff152d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd802c370 0x558fd8036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff151d9b640 1 -- 172.21.15.18:0/510892120 learned_addr learned my addr 172.21.15.18:0/510892120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff15259c640 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80269a0 0x558fd80338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff152d9d640 1 -- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80269a0 msgr2=0x558fd80338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff152d9d640 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80269a0 0x558fd80338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff152d9d640 1 -- 172.21.15.18:0/510892120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80272e0 msgr2=0x558fd8033df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff152d9d640 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80272e0 0x558fd8033df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.960+0000 7ff152d9d640 1 -- 172.21.15.18:0/510892120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd8037420 con 0x558fd802c370 2024-09-19T08:49:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.961+0000 7ff152d9d640 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd802c370 0x558fd8036e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0a4c30 tx=0x7ff14c00ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3fe4b3808021b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.961+0000 7ff139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.961+0000 7ff139ffb640 1 -- 172.21.15.18:0/510892120 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c065460 con 0x558fd802c370 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff14401da70 con 0x558fd802c370 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff139ffb640 1 -- 172.21.15.18:0/510892120 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff14c09c950 con 0x558fd802c370 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff139ffb640 1 -- 172.21.15.18:0/510892120 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff14c0af030 con 0x558fd802c370 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff15bc02740 10 client.25246 fetch_fsmap learned FSMap version 21 2024-09-19T08:49:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558fd80abb40 con 0x558fd802c370 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff139ffb640 1 -- 172.21.15.18:0/510892120 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14c009820 con 0x558fd802c370 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.962+0000 7ff139ffb640 1 -- 172.21.15.18:0/510892120 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff14c066f10 con 0x558fd802c370 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15bc02740 10 client.25246 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15bc02740 10 client.25246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15bc02740 20 client.25246 populate_metadata read hostname 'smithi018' 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15bc02740 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd80ac170 0x558fd80ae560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15bc02740 4 client.25246 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:49:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff14401da70 con 0x558fd80ac170 2024-09-19T08:49:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15259c640 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd80ac170 0x558fd80ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff15259c640 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd80ac170 0x558fd80ae560 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26db8f8f15ee577e server_cookie=ccd9c881a8919c8c in_seq=0 out_seq=0 2024-09-19T08:49:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.963+0000 7ff139ffb640 10 client.25246 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff139ffb640 1 -- 172.21.15.18:0/510892120 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff14401da70 con 0x558fd80ac170 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff139ffb640 10 client.25246 handle_command_reply: tid=0 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 client.25246 shutdown 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd802c370 msgr2=0x558fd8036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd802c370 0x558fd8036e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0a4c30 tx=0x7ff14c00ce70 comp rx=0 tx=0).stop 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 shutdown_connections 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x558fd80ac170 0x558fd80ae560 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fd802c370 0x558fd8036e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558fd80272e0 0x558fd8033df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 --2- 172.21.15.18:0/510892120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558fd80269a0 0x558fd80338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff139ffb640 0 client.25246 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 >> 172.21.15.18:0/510892120 conn(0x558fd8022010 msgr2=0x558fd80209a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 shutdown_connections 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 1 -- 172.21.15.18:0/510892120 wait complete. 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.976+0000 7ff15bc02740 20 client.25246 trim_cache size 0 max 16384 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:49:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:49:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff13c0a32f0 msgr2=0x7ff13c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff13c0a32f0 0x7ff13c0a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x558fd8027d10 tx=0x7ff148000bc0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154103710 msgr2=0x7ff15419f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154103710 0x7ff15419f2a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00ec50 tx=0x7ff14c00c6a0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 shutdown_connections 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff13c0a32f0 0x7ff13c0a57b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff154103710 0x7ff15419f2a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff154102d50 0x7ff154198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 --2- 172.21.15.18:0/1778171504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff154101b60 0x7ff154197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 >> 172.21.15.18:0/1778171504 conn(0x7ff1540fd2e0 msgr2=0x7ff154106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 shutdown_connections 2024-09-19T08:49:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:49:55.977+0000 7ff158e65640 1 -- 172.21.15.18:0/1778171504 wait complete. 2024-09-19T08:49:56.911 INFO:tasks.workunit.client.0.smithi018.stdout:30000 mapread 0x3fc9cb thru 0x4052a3 (0x88d9 bytes) 2024-09-19T08:49:57.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:57 smithi162 ceph-mon[34870]: pgmap v489: 129 pgs: 129 active+clean; 44 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 3.2 MiB/s wr, 508 op/s 2024-09-19T08:49:57.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:57 smithi018 ceph-mon[30956]: pgmap v489: 129 pgs: 129 active+clean; 44 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 3.2 MiB/s wr, 508 op/s 2024-09-19T08:49:57.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:57 smithi150 ceph-mon[34610]: pgmap v489: 129 pgs: 129 active+clean; 44 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 3.2 MiB/s wr, 508 op/s 2024-09-19T08:49:59.365 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:49:59 smithi150 ceph-mon[34610]: pgmap v490: 129 pgs: 129 active+clean; 40 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 510 op/s 2024-09-19T08:49:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:49:59 smithi162 ceph-mon[34870]: pgmap v490: 129 pgs: 129 active+clean; 40 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 510 op/s 2024-09-19T08:49:59.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:49:59 smithi018 ceph-mon[30956]: pgmap v490: 129 pgs: 129 active+clean; 40 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 510 op/s 2024-09-19T08:50:00.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:00 smithi162 ceph-mon[34870]: overall HEALTH_OK 2024-09-19T08:50:00.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:00 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T08:50:00.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:00 smithi150 ceph-mon[34610]: overall HEALTH_OK 2024-09-19T08:50:01.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:01 smithi162 ceph-mon[34870]: pgmap v491: 129 pgs: 129 active+clean; 36 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 518 op/s 2024-09-19T08:50:01.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:01 smithi018 ceph-mon[30956]: pgmap v491: 129 pgs: 129 active+clean; 36 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 518 op/s 2024-09-19T08:50:01.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:01 smithi150 ceph-mon[34610]: pgmap v491: 129 pgs: 129 active+clean; 36 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 518 op/s 2024-09-19T08:50:03.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:03 smithi162 ceph-mon[34870]: pgmap v492: 129 pgs: 129 active+clean; 39 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.6 MiB/s wr, 542 op/s 2024-09-19T08:50:03.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:03 smithi018 ceph-mon[30956]: pgmap v492: 129 pgs: 129 active+clean; 39 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.6 MiB/s wr, 542 op/s 2024-09-19T08:50:03.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:03 smithi150 ceph-mon[34610]: pgmap v492: 129 pgs: 129 active+clean; 39 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.6 MiB/s wr, 542 op/s 2024-09-19T08:50:05.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:05 smithi162 ceph-mon[34870]: pgmap v493: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.4 MiB/s wr, 497 op/s 2024-09-19T08:50:05.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:05 smithi018 ceph-mon[30956]: pgmap v493: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.4 MiB/s wr, 497 op/s 2024-09-19T08:50:05.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:05 smithi150 ceph-mon[34610]: pgmap v493: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.4 MiB/s wr, 497 op/s 2024-09-19T08:50:07.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:07 smithi162 ceph-mon[34870]: pgmap v494: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.2 MiB/s wr, 486 op/s 2024-09-19T08:50:07.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:07 smithi018 ceph-mon[30956]: pgmap v494: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.2 MiB/s wr, 486 op/s 2024-09-19T08:50:07.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:07 smithi150 ceph-mon[34610]: pgmap v494: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.2 MiB/s wr, 486 op/s 2024-09-19T08:50:09.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 -- 172.21.15.18:0/3635800183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884101710 msgr2=0x7ff884101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3635800183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884101710 0x7ff884101bc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009ca0 tx=0x7ff87c02a950 comp rx=0 tx=0).stop 2024-09-19T08:50:09.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 -- 172.21.15.18:0/3635800183 shutdown_connections 2024-09-19T08:50:09.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3635800183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884101710 0x7ff884101bc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3635800183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100d70 0x7ff8841011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3635800183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff884100430 0x7ff884100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 -- 172.21.15.18:0/3635800183 >> 172.21.15.18:0/3635800183 conn(0x7ff8840fc1e0 msgr2=0x7ff8840fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 -- 172.21.15.18:0/3635800183 shutdown_connections 2024-09-19T08:50:09.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.100+0000 7ff8898a5640 1 -- 172.21.15.18:0/3635800183 wait complete. 2024-09-19T08:50:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.101+0000 7ff8898a5640 1 Processor -- start 2024-09-19T08:50:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.101+0000 7ff8898a5640 1 -- start start 2024-09-19T08:50:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8898a5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 0x7ff884199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8898a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 0x7ff88419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8898a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff884101710 0x7ff8841a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8898a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff88410f870 con 0x7ff884100d70 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8898a5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff88410f6f0 con 0x7ff884100430 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8898a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff88410f9f0 con 0x7ff884101710 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 0x7ff884199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 0x7ff88419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 0x7ff884199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:35210/0 (socket says 172.21.15.18:35210) 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 -- 172.21.15.18:0/3329026237 learned_addr learned my addr 172.21.15.18:0/3329026237 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 0x7ff88419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59466/0 (socket says 172.21.15.18:59466) 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff884101710 0x7ff8841a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 -- 172.21.15.18:0/3329026237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff884101710 msgr2=0x7ff8841a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff884101710 0x7ff8841a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 -- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 msgr2=0x7ff88419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 0x7ff88419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff882ffd640 1 -- 172.21.15.18:0/3329026237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841a1af0 con 0x7ff884100430 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.102+0000 7ff8827fc640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 0x7ff88419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.103+0000 7ff882ffd640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 0x7ff884199ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff87400e9f0 tx=0x7ff87400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.103+0000 7ff8888a3640 1 -- 172.21.15.18:0/3329026237 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87400cd80 con 0x7ff884100430 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.103+0000 7ff8888a3640 1 -- 172.21.15.18:0/3329026237 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8740054d0 con 0x7ff884100430 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.103+0000 7ff8888a3640 1 -- 172.21.15.18:0/3329026237 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874010490 con 0x7ff884100430 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.103+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8841a1de0 con 0x7ff884100430 2024-09-19T08:50:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.103+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8841a21f0 con 0x7ff884100430 2024-09-19T08:50:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.106+0000 7ff8888a3640 1 -- 172.21.15.18:0/3329026237 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff874005020 con 0x7ff884100430 2024-09-19T08:50:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 Processor -- start 2024-09-19T08:50:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 -- start start 2024-09-19T08:50:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c03bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03c2e0 0x55647c040da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c043830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55647bf9f2f0 con 0x55647c03b9a0 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55647bf47270 con 0x55647c03c2e0 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.107+0000 7ff88c647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55647bf9b2b0 con 0x55647c041370 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03c2e0 0x55647c040da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c03bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c043830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c03bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59476/0 (socket says 172.21.15.18:59476) 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8837fe640 1 -- 172.21.15.18:0/3523533289 learned_addr learned my addr 172.21.15.18:0/3523533289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c043830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:38520/0 (socket says 172.21.15.18:38520) 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8888a3640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff86c0a32f0 0x7ff86c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff86c0a32f0 0x7ff86c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 -- 172.21.15.18:0/3523533289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03c2e0 msgr2=0x55647c040da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03c2e0 0x55647c040da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 -- 172.21.15.18:0/3523533289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 msgr2=0x55647c03bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c03bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8827fc640 1 -- 172.21.15.18:0/3523533289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647bf46340 con 0x55647c041370 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.108+0000 7ff8888a3640 1 -- 172.21.15.18:0/3329026237 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff8740d00a0 con 0x7ff884100430 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.109+0000 7ff8827fc640 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c043830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff878009fa0 tx=0x7ff8780118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640fe58c0f10ad5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.109+0000 7ff869ffb640 1 -- 172.21.15.18:0/3523533289 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878004020 con 0x55647c041370 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.109+0000 7ff869ffb640 1 -- 172.21.15.18:0/3523533289 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8780041c0 con 0x55647c041370 2024-09-19T08:50:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.109+0000 7ff869ffb640 1 -- 172.21.15.18:0/3523533289 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87800f7e0 con 0x55647c041370 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 -- 172.21.15.18:0/3523533289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 msgr2=0x55647c043830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff86c0a32f0 0x7ff86c0a57b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff87c005fe0 tx=0x7ff87c02a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c043830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff878009fa0 tx=0x7ff8780118d0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 -- 172.21.15.18:0/3523533289 shutdown_connections 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c043830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03c2e0 0x55647c040da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 --2- 172.21.15.18:0/3523533289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c03bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 -- 172.21.15.18:0/3523533289 >> 172.21.15.18:0/3523533289 conn(0x55647c037010 msgr2=0x55647c037410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 -- 172.21.15.18:0/3523533289 shutdown_connections 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 -- 172.21.15.18:0/3523533289 wait complete. 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.110+0000 7ff88c647740 1 -- start start 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.111+0000 7ff88c647740 1 Processor -- start 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c045bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c046110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c04d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55647c044340 con 0x55647c03b9a0 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55647bf28290 con 0x55647c041370 2024-09-19T08:50:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55647c0444c0 con 0x55647c03c2e0 2024-09-19T08:50:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff88c647740 10 client.0 _ll_register_callbacks cb 0x55647bf59140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c045bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c045bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59482/0 (socket says 172.21.15.18:59482) 2024-09-19T08:50:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff882ffd640 1 -- 172.21.15.18:0/3791791034 learned_addr learned my addr 172.21.15.18:0/3791791034 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.112+0000 7ff8827fc640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c046110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.113+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c04d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.113+0000 7ff8837fe640 1 -- 172.21.15.18:0/3791791034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 msgr2=0x55647c046110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.113+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c046110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.113+0000 7ff8837fe640 1 -- 172.21.15.18:0/3791791034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 msgr2=0x55647c045bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.113+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c045bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.113+0000 7ff8837fe640 1 -- 172.21.15.18:0/3791791034 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55647bcb2210 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.114+0000 7ff8837fe640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c04d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff87c02ae70 tx=0x7ff87c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5f91f1cf52cc9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.114+0000 7ff862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.114+0000 7ff862ffd640 1 -- 172.21.15.18:0/3791791034 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c043040 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.114+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8780041c0 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.114+0000 7ff862ffd640 1 -- 172.21.15.18:0/3791791034 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff87c004450 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff862ffd640 1 -- 172.21.15.18:0/3791791034 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff87c05b050 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 10 client.25175 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55647bd7e620 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff862ffd640 1 -- 172.21.15.18:0/3791791034 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8780041c0 con 0x55647c041370 2024-09-19T08:50:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff862ffd640 1 -- 172.21.15.18:0/3791791034 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff87c04a430 con 0x55647c041370 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 10 client.25175 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 10 client.25175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 20 client.25175 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c053c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 4 client.25175 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55647bfaca20 con 0x55647c051860 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.115+0000 7ff882ffd640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c053c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.116+0000 7ff882ffd640 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c053c90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca9c9306b09c1a3 server_cookie=5a442262754bbb29 in_seq=0 out_seq=0 2024-09-19T08:50:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.116+0000 7ff862ffd640 10 client.25175 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff862ffd640 1 -- 172.21.15.18:0/3791791034 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55647bfaca20 con 0x55647c051860 2024-09-19T08:50:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff862ffd640 10 client.25175 handle_command_reply: tid=0 2024-09-19T08:50:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 client.25175 shutdown 2024-09-19T08:50:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 msgr2=0x55647c04d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c04d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff87c02ae70 tx=0x7ff87c0095c0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 shutdown_connections 2024-09-19T08:50:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c053c90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff862ffd640 0 client.25175 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c04d150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c046110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 --2- 172.21.15.18:0/3791791034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c045bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.117+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 >> 172.21.15.18:0/3791791034 conn(0x55647c037010 msgr2=0x55647c038820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.118+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 shutdown_connections 2024-09-19T08:50:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.118+0000 7ff88c647740 1 -- 172.21.15.18:0/3791791034 wait complete. 2024-09-19T08:50:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.118+0000 7ff88c647740 20 client.25175 trim_cache size 0 max 16384 2024-09-19T08:50:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 Processor -- start 2024-09-19T08:50:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 -- start start 2024-09-19T08:50:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c037ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c04d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c038400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841aa910 con 0x55647c03b9a0 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841ad190 con 0x55647c041370 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff88c647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841aaf80 con 0x55647c03c2e0 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c037ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c037ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59496/0 (socket says 172.21.15.18:59496) 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 -- 172.21.15.18:0/1449534764 learned_addr learned my addr 172.21.15.18:0/1449534764 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff8837fe640 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c038400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff8827fc640 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c04d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 -- 172.21.15.18:0/1449534764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 msgr2=0x55647c04d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c04d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 -- 172.21.15.18:0/1449534764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 msgr2=0x55647c038400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c038400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.139+0000 7ff882ffd640 1 -- 172.21.15.18:0/1449534764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647c0322d0 con 0x55647c03b9a0 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.140+0000 7ff8827fc640 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c04d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.140+0000 7ff882ffd640 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c037ec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff87409bf90 tx=0x7ff8740bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c8904595cda0b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.140+0000 7ff8697fa640 1 -- 172.21.15.18:0/1449534764 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874005680 con 0x55647c03b9a0 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.140+0000 7ff8697fa640 1 -- 172.21.15.18:0/1449534764 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff87409c990 con 0x55647c03b9a0 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.140+0000 7ff8697fa640 1 -- 172.21.15.18:0/1449534764 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740cd880 con 0x55647c03b9a0 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 -- 172.21.15.18:0/1449534764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 msgr2=0x55647c037ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c037ec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff87409bf90 tx=0x7ff8740bc040 comp rx=0 tx=0).stop 2024-09-19T08:50:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 -- 172.21.15.18:0/1449534764 shutdown_connections 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c041370 0x55647c038400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c03c2e0 0x55647c04d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 --2- 172.21.15.18:0/1449534764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03b9a0 0x55647c037ec0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 -- 172.21.15.18:0/1449534764 >> 172.21.15.18:0/1449534764 conn(0x55647c037010 msgr2=0x55647c045bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 -- 172.21.15.18:0/1449534764 shutdown_connections 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 -- 172.21.15.18:0/1449534764 wait complete. 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 -- start start 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.141+0000 7ff88c647740 1 Processor -- start 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 0x55647c04a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 0x55647c04a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c0ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841ab650 con 0x55647c03c2e0 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841acac0 con 0x55647c03b9a0 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841abd20 con 0x55647c041370 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff88c647740 10 client.0 _ll_register_callbacks cb 0x7ff874005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff8827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 0x55647c04a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 0x55647c04a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 0x55647c04a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:35266/0 (socket says 172.21.15.18:35266) 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff8827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 0x55647c04a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59504/0 (socket says 172.21.15.18:59504) 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 -- 172.21.15.18:0/1468119059 learned_addr learned my addr 172.21.15.18:0/1468119059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff8837fe640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c0ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 -- 172.21.15.18:0/1468119059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 msgr2=0x55647c0ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c0ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 -- 172.21.15.18:0/1468119059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 msgr2=0x55647c04a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 0x55647c04a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff882ffd640 1 -- 172.21.15.18:0/1468119059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55647c0baa90 con 0x55647c03b9a0 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.142+0000 7ff8827fc640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 0x55647c04a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff882ffd640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 0x55647c04a190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c6a0 tx=0x7ff87400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b285fd00ab3527f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff862ffd640 1 -- 172.21.15.18:0/1468119059 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740b5060 con 0x55647c03b9a0 2024-09-19T08:50:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff862ffd640 1 -- 172.21.15.18:0/1468119059 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff8740b5200 con 0x55647c03b9a0 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff87409c990 con 0x55647c03b9a0 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff862ffd640 1 -- 172.21.15.18:0/1468119059 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff874005680 con 0x55647c03b9a0 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff88c647740 10 client.25181 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.143+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55647c0bbe10 con 0x55647c03b9a0 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff862ffd640 1 -- 172.21.15.18:0/1468119059 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff87409c990 con 0x55647c03b9a0 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff862ffd640 1 -- 172.21.15.18:0/1468119059 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff87409c4f0 con 0x55647c03b9a0 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff88c647740 10 client.25181 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff88c647740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff88c647740 20 client.25181 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff88c647740 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c0be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff88c647740 4 client.25181 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:50:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.144+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55647bfa6d70 con 0x55647c051860 2024-09-19T08:50:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.145+0000 7ff8827fc640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c0be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.145+0000 7ff862ffd640 10 client.25181 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.145+0000 7ff8827fc640 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c0be6d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=648a872473346d6d server_cookie=283104ccb3a1fd7 in_seq=0 out_seq=0 2024-09-19T08:50:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff862ffd640 1 -- 172.21.15.18:0/1468119059 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55647bfa6d70 con 0x55647c051860 2024-09-19T08:50:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff862ffd640 10 client.25181 handle_command_reply: tid=0 2024-09-19T08:50:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 client.25181 shutdown 2024-09-19T08:50:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 msgr2=0x55647c04a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 0x55647c04a190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c6a0 tx=0x7ff87400c7d0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 shutdown_connections 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55647c051860 0x55647c0be6d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55647c041370 0x55647c0ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55647c03c2e0 0x55647c04a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 --2- 172.21.15.18:0/1468119059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55647c03b9a0 0x55647c04a190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 >> 172.21.15.18:0/1468119059 conn(0x55647c037010 msgr2=0x55647c0359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff862ffd640 0 client.25181 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 shutdown_connections 2024-09-19T08:50:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.159+0000 7ff88c647740 1 -- 172.21.15.18:0/1468119059 wait complete. 2024-09-19T08:50:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff88c647740 20 client.25181 trim_cache size 0 max 16384 2024-09-19T08:50:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:50:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:50:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:50:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:50:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff86c0a32f0 msgr2=0x7ff86c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff86c0a32f0 0x7ff86c0a57b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff87c005fe0 tx=0x7ff87c02a950 comp rx=0 tx=0).stop 2024-09-19T08:50:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 msgr2=0x7ff884199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 0x7ff884199ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff87400e9f0 tx=0x7ff87400edf0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 shutdown_connections 2024-09-19T08:50:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff86c0a32f0 0x7ff86c0a57b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff884101710 0x7ff8841a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884100d70 0x7ff88419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 --2- 172.21.15.18:0/3329026237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff884100430 0x7ff884199ed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 >> 172.21.15.18:0/3329026237 conn(0x7ff8840fc1e0 msgr2=0x7ff8840fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.160+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 shutdown_connections 2024-09-19T08:50:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:09.161+0000 7ff8898a5640 1 -- 172.21.15.18:0/3329026237 wait complete. 2024-09-19T08:50:09.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:09 smithi162 ceph-mon[34870]: pgmap v495: 129 pgs: 129 active+clean; 40 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.4 MiB/s wr, 485 op/s 2024-09-19T08:50:09.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:09 smithi018 ceph-mon[30956]: pgmap v495: 129 pgs: 129 active+clean; 40 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.4 MiB/s wr, 485 op/s 2024-09-19T08:50:09.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:09 smithi150 ceph-mon[34610]: pgmap v495: 129 pgs: 129 active+clean; 40 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.4 MiB/s wr, 485 op/s 2024-09-19T08:50:11.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:11 smithi162 ceph-mon[34870]: pgmap v496: 129 pgs: 129 active+clean; 37 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 492 op/s 2024-09-19T08:50:11.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:11 smithi018 ceph-mon[30956]: pgmap v496: 129 pgs: 129 active+clean; 37 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 492 op/s 2024-09-19T08:50:11.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:11 smithi150 ceph-mon[34610]: pgmap v496: 129 pgs: 129 active+clean; 37 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 492 op/s 2024-09-19T08:50:13.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:13 smithi162 ceph-mon[34870]: pgmap v497: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.8 MiB/s wr, 553 op/s 2024-09-19T08:50:13.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:13 smithi018 ceph-mon[30956]: pgmap v497: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.8 MiB/s wr, 553 op/s 2024-09-19T08:50:13.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:13 smithi150 ceph-mon[34610]: pgmap v497: 129 pgs: 129 active+clean; 42 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.8 MiB/s wr, 553 op/s 2024-09-19T08:50:15.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:15 smithi162 ceph-mon[34870]: pgmap v498: 129 pgs: 129 active+clean; 46 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.5 MiB/s wr, 500 op/s 2024-09-19T08:50:15.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:15 smithi018 ceph-mon[30956]: pgmap v498: 129 pgs: 129 active+clean; 46 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.5 MiB/s wr, 500 op/s 2024-09-19T08:50:15.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:15 smithi150 ceph-mon[34610]: pgmap v498: 129 pgs: 129 active+clean; 46 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.5 MiB/s wr, 500 op/s 2024-09-19T08:50:17.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:17 smithi162 ceph-mon[34870]: pgmap v499: 129 pgs: 129 active+clean; 45 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.1 MiB/s wr, 447 op/s 2024-09-19T08:50:17.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:17 smithi018 ceph-mon[30956]: pgmap v499: 129 pgs: 129 active+clean; 45 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.1 MiB/s wr, 447 op/s 2024-09-19T08:50:17.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:17 smithi150 ceph-mon[34610]: pgmap v499: 129 pgs: 129 active+clean; 45 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.1 MiB/s wr, 447 op/s 2024-09-19T08:50:19.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:19 smithi162 ceph-mon[34870]: pgmap v500: 129 pgs: 129 active+clean; 45 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.2 MiB/s wr, 480 op/s 2024-09-19T08:50:19.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:19 smithi018 ceph-mon[30956]: pgmap v500: 129 pgs: 129 active+clean; 45 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.2 MiB/s wr, 480 op/s 2024-09-19T08:50:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:19 smithi150 ceph-mon[34610]: pgmap v500: 129 pgs: 129 active+clean; 45 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.2 MiB/s wr, 480 op/s 2024-09-19T08:50:20.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:20.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:20.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:20.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:50:20.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:20.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:20.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:20.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:50:20.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:20.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:20.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:20.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:50:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:21 smithi150 ceph-mon[34610]: pgmap v501: 129 pgs: 129 active+clean; 44 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.3 MiB/s wr, 496 op/s 2024-09-19T08:50:22.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:21 smithi162 ceph-mon[34870]: pgmap v501: 129 pgs: 129 active+clean; 44 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.3 MiB/s wr, 496 op/s 2024-09-19T08:50:22.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:21 smithi018 ceph-mon[30956]: pgmap v501: 129 pgs: 129 active+clean; 44 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.3 MiB/s wr, 496 op/s 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 -- 172.21.15.18:0/3708566663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 msgr2=0x7fa2581020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3708566663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa2581020c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa248009900 tx=0x7fa24802a410 comp rx=0 tx=0).stop 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 -- 172.21.15.18:0/3708566663 shutdown_connections 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3708566663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa258102600 0x7fa258108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3708566663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa2581020c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3708566663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa258100a50 0x7fa258100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 -- 172.21.15.18:0/3708566663 >> 172.21.15.18:0/3708566663 conn(0x7fa2580fc1b0 msgr2=0x7fa2580fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 -- 172.21.15.18:0/3708566663 shutdown_connections 2024-09-19T08:50:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.276+0000 7fa2605c4640 1 -- 172.21.15.18:0/3708566663 wait complete. 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 Processor -- start 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 -- start start 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa258100a50 0x7fa25806ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa25819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa258102600 0x7fa25819f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa25810c560 con 0x7fa258101c40 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa25810c3e0 con 0x7fa258102600 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa2605c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa25810c6e0 con 0x7fa258100a50 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa25db5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa25819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa25db5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa25819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55410/0 (socket says 172.21.15.18:55410) 2024-09-19T08:50:22.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa25db5f640 1 -- 172.21.15.18:0/3793881122 learned_addr learned my addr 172.21.15.18:0/3793881122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa25e360640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa258100a50 0x7fa25806ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.277+0000 7fa25eb61640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa258102600 0x7fa25819f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa25db5f640 1 -- 172.21.15.18:0/3793881122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa258100a50 msgr2=0x7fa25806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa258100a50 0x7fa25806ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa25db5f640 1 -- 172.21.15.18:0/3793881122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa258102600 msgr2=0x7fa25819f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa258102600 0x7fa25819f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa25db5f640 1 -- 172.21.15.18:0/3793881122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25819f940 con 0x7fa258101c40 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa25819ca10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa248005940 tx=0x7fa2480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa24f7fe640 1 -- 172.21.15.18:0/3793881122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24803f030 con 0x7fa258101c40 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa24f7fe640 1 -- 172.21.15.18:0/3793881122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa248003cb0 con 0x7fa258101c40 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25819fb70 con 0x7fa258101c40 2024-09-19T08:50:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa24f7fe640 1 -- 172.21.15.18:0/3793881122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248035070 con 0x7fa258101c40 2024-09-19T08:50:22.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.278+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2581a0060 con 0x7fa258101c40 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.281+0000 7fa26343f740 1 Processor -- start 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.281+0000 7fa26343f740 1 -- start start 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa26343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603be9a0 0x562e603beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa26343f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603bf2e0 0x562e603c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa26343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603c4370 0x562e603c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa26343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562e603222f0 con 0x562e603be9a0 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa26343f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x562e602ca270 con 0x562e603bf2e0 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa26343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e6031e2b0 con 0x562e603c4370 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa24f7fe640 1 -- 172.21.15.18:0/3793881122 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa248042030 con 0x7fa258101c40 2024-09-19T08:50:22.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25eb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603be9a0 0x562e603beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25eb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603be9a0 0x562e603beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55426/0 (socket says 172.21.15.18:55426) 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25eb61640 1 -- 172.21.15.18:0/2655167495 learned_addr learned my addr 172.21.15.18:0/2655167495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25db5f640 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603c4370 0x562e603c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25e360640 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603bf2e0 0x562e603c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25e360640 1 -- 172.21.15.18:0/2655167495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603c4370 msgr2=0x562e603c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25e360640 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603c4370 0x562e603c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25e360640 1 -- 172.21.15.18:0/2655167495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603be9a0 msgr2=0x562e603beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25e360640 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603be9a0 0x562e603beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.282+0000 7fa25e360640 1 -- 172.21.15.18:0/2655167495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e602c9340 con 0x562e603bf2e0 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.283+0000 7fa25e360640 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603bf2e0 0x562e603c3da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa254009b40 tx=0x7fa2540113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e25487c6adf5c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.283+0000 7fa24f7fe640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa2440a32f0 0x7fa2440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.283+0000 7fa25eb61640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa2440a32f0 0x7fa2440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.283+0000 7fa24f7fe640 1 -- 172.21.15.18:0/3793881122 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa2480f0350 con 0x7fa258101c40 2024-09-19T08:50:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.283+0000 7fa24cbfe640 1 -- 172.21.15.18:0/2655167495 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254011e10 con 0x562e603bf2e0 2024-09-19T08:50:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.283+0000 7fa24cbfe640 1 -- 172.21.15.18:0/2655167495 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa254012900 con 0x562e603bf2e0 2024-09-19T08:50:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa24cbfe640 1 -- 172.21.15.18:0/2655167495 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25400f980 con 0x562e603bf2e0 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 -- 172.21.15.18:0/2655167495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603bf2e0 msgr2=0x562e603c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa25eb61640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa2440a32f0 0x7fa2440a57b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa250005c40 tx=0x7fa2500097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603bf2e0 0x562e603c3da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa254009b40 tx=0x7fa2540113e0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 -- 172.21.15.18:0/2655167495 shutdown_connections 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603c4370 0x562e603c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603bf2e0 0x562e603c3da0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 --2- 172.21.15.18:0/2655167495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603be9a0 0x562e603beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 -- 172.21.15.18:0/2655167495 >> 172.21.15.18:0/2655167495 conn(0x562e603ba010 msgr2=0x562e603ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 -- 172.21.15.18:0/2655167495 shutdown_connections 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.284+0000 7fa26343f740 1 -- 172.21.15.18:0/2655167495 wait complete. 2024-09-19T08:50:22.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 -- start start 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 Processor -- start 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562e603c73e0 con 0x562e603bf2e0 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x562e602ab290 con 0x562e603c4370 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e603c7560 con 0x562e603be9a0 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa26343f740 10 client.0 _ll_register_callbacks cb 0x562e602dc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa25db5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa25e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa25e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53250/0 (socket says 172.21.15.18:53250) 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa25e360640 1 -- 172.21.15.18:0/541202431 learned_addr learned my addr 172.21.15.18:0/541202431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.285+0000 7fa25eb61640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25db5f640 1 -- 172.21.15.18:0/541202431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 msgr2=0x562e603c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25db5f640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25db5f640 1 -- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 msgr2=0x562e603d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25db5f640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25db5f640 1 -- 172.21.15.18:0/541202431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e60035210 con 0x562e603bf2e0 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25e360640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa25db5f640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603c9170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa2480edad0 tx=0x7fa2480b8240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522a67bf735a56bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa241ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa241ffb640 1 -- 172.21.15.18:0/541202431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248049040 con 0x562e603bf2e0 2024-09-19T08:50:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa254012900 con 0x562e603bf2e0 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.286+0000 7fa241ffb640 1 -- 172.21.15.18:0/541202431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa24803b460 con 0x562e603bf2e0 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa241ffb640 1 -- 172.21.15.18:0/541202431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2480bc0e0 con 0x562e603bf2e0 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 10 client.15555 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562e60101620 con 0x562e603bf2e0 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa241ffb640 1 -- 172.21.15.18:0/541202431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa254012900 con 0x562e603bf2e0 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa241ffb640 1 -- 172.21.15.18:0/541202431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa2480b8c10 con 0x562e603bf2e0 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 10 client.15555 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 20 client.15555 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e603d8c30 0x562e603db060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.287+0000 7fa26343f740 4 client.15555 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.288+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e6032fa20 con 0x562e603d8c30 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.288+0000 7fa25e360640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e603d8c30 0x562e603db060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.288+0000 7fa241ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.288+0000 7fa25e360640 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e603d8c30 0x562e603db060 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e7218266f7886b server_cookie=b48ec88941e862f in_seq=0 out_seq=0 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa241ffb640 1 -- 172.21.15.18:0/541202431 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e6032fa20 con 0x562e603d8c30 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa241ffb640 10 client.15555 handle_command_reply: tid=0 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 client.15555 shutdown 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 msgr2=0x562e603c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603c9170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa2480edad0 tx=0x7fa2480b8240 comp rx=0 tx=0).stop 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 shutdown_connections 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e603d8c30 0x562e603db060 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa241ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603c9170 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 --2- 172.21.15.18:0/541202431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 >> 172.21.15.18:0/541202431 conn(0x562e603ba010 msgr2=0x562e603bb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 shutdown_connections 2024-09-19T08:50:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.289+0000 7fa26343f740 1 -- 172.21.15.18:0/541202431 wait complete. 2024-09-19T08:50:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.290+0000 7fa26343f740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T08:50:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 Processor -- start 2024-09-19T08:50:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 -- start start 2024-09-19T08:50:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603bae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a6500 con 0x562e603bf2e0 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a8d80 con 0x562e603c4370 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa26343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a6b70 con 0x562e603be9a0 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25db5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25db5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55440/0 (socket says 172.21.15.18:55440) 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53266/0 (socket says 172.21.15.18:53266) 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25db5f640 1 -- 172.21.15.18:0/1583295875 learned_addr learned my addr 172.21.15.18:0/1583295875 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25eb61640 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 -- 172.21.15.18:0/1583295875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 msgr2=0x562e603bae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603bae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 -- 172.21.15.18:0/1583295875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 msgr2=0x562e603d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25e360640 1 -- 172.21.15.18:0/1583295875 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e603bf7c0 con 0x562e603be9a0 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.309+0000 7fa25db5f640 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.310+0000 7fa25e360640 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa254009900 tx=0x7fa2540095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e77c446381047ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.310+0000 7fa243fff640 1 -- 172.21.15.18:0/1583295875 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254013d60 con 0x562e603be9a0 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.310+0000 7fa243fff640 1 -- 172.21.15.18:0/1583295875 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa254029070 con 0x562e603be9a0 2024-09-19T08:50:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.310+0000 7fa243fff640 1 -- 172.21.15.18:0/1583295875 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254012b50 con 0x562e603be9a0 2024-09-19T08:50:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- 172.21.15.18:0/1583295875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 msgr2=0x562e603c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa254009900 tx=0x7fa2540095b0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- 172.21.15.18:0/1583295875 shutdown_connections 2024-09-19T08:50:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603bae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- 172.21.15.18:0/1583295875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603c8190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- 172.21.15.18:0/1583295875 >> 172.21.15.18:0/1583295875 conn(0x562e603ba010 msgr2=0x562e603c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- 172.21.15.18:0/1583295875 shutdown_connections 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- 172.21.15.18:0/1583295875 wait complete. 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- start start 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 Processor -- start 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a7240 con 0x562e603bf2e0 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a86b0 con 0x562e603c4370 2024-09-19T08:50:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.311+0000 7fa26343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a7910 con 0x562e603be9a0 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53270/0 (socket says 172.21.15.18:53270) 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 -- 172.21.15.18:0/3205390124 learned_addr learned my addr 172.21.15.18:0/3205390124 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa26343f740 10 client.0 _ll_register_callbacks cb 0x7fa2480f3b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25eb61640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 -- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 msgr2=0x562e603cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 -- 172.21.15.18:0/3205390124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 msgr2=0x562e603cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 -- 172.21.15.18:0/3205390124 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e603cf080 con 0x562e603be9a0 2024-09-19T08:50:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25eb61640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa25e360640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603cd570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa254009460 tx=0x7fa254014b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9a3300b8acaea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa241ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa241ffb640 1 -- 172.21.15.18:0/3205390124 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254012ae0 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa241ffb640 1 -- 172.21.15.18:0/3205390124 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa254012c80 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.312+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa254029070 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa241ffb640 1 -- 172.21.15.18:0/3205390124 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2540050b0 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 10 client.25282 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562e603d0370 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa241ffb640 1 -- 172.21.15.18:0/3205390124 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa254029070 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa241ffb640 1 -- 172.21.15.18:0/3205390124 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa25402d030 con 0x562e603be9a0 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 10 client.25282 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 10 client.25282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 20 client.25282 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e60443e40 0x562e60446260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 4 client.25282 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:50:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e60329d70 con 0x562e60443e40 2024-09-19T08:50:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.313+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e60443e40 0x562e60446260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.314+0000 7fa241ffb640 10 client.25282 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.314+0000 7fa25db5f640 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e60443e40 0x562e60446260 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc97c374cce67f86 server_cookie=ce326f006964bba4 in_seq=0 out_seq=0 2024-09-19T08:50:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa241ffb640 1 -- 172.21.15.18:0/3205390124 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e60329d70 con 0x562e60443e40 2024-09-19T08:50:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa241ffb640 10 client.25282 handle_command_reply: tid=0 2024-09-19T08:50:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 client.25282 shutdown 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 msgr2=0x562e603cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603cd570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa254009460 tx=0x7fa254014b70 comp rx=0 tx=0).stop 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 shutdown_connections 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562e60443e40 0x562e60446260 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562e603c4370 0x562e603cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e603bf2e0 0x562e603cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 --2- 172.21.15.18:0/3205390124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e603be9a0 0x562e603cd570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 >> 172.21.15.18:0/3205390124 conn(0x562e603ba010 msgr2=0x562e603b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa241ffb640 0 client.25282 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 shutdown_connections 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.327+0000 7fa26343f740 1 -- 172.21.15.18:0/3205390124 wait complete. 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.328+0000 7fa26343f740 20 client.25282 trim_cache size 0 max 16384 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:50:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:50:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.328+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa2440a32f0 msgr2=0x7fa2440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.328+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa2440a32f0 0x7fa2440a57b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa250005c40 tx=0x7fa2500097e0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.328+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 msgr2=0x7fa25819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.328+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa25819ca10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa248005940 tx=0x7fa2480042f0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 shutdown_connections 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fa2440a32f0 0x7fa2440a57b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa258102600 0x7fa25819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258101c40 0x7fa25819ca10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 --2- 172.21.15.18:0/3793881122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa258100a50 0x7fa25806ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 >> 172.21.15.18:0/3793881122 conn(0x7fa2580fc1b0 msgr2=0x7fa258105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 shutdown_connections 2024-09-19T08:50:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:22.329+0000 7fa2605c4640 1 -- 172.21.15.18:0/3793881122 wait complete. 2024-09-19T08:50:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:23 smithi150 ceph-mon[34610]: pgmap v502: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.5 MiB/s wr, 539 op/s 2024-09-19T08:50:24.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:23 smithi162 ceph-mon[34870]: pgmap v502: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.5 MiB/s wr, 539 op/s 2024-09-19T08:50:24.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:23 smithi018 ceph-mon[30956]: pgmap v502: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.5 MiB/s wr, 539 op/s 2024-09-19T08:50:26.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:25 smithi150 ceph-mon[34610]: pgmap v503: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.1 MiB/s wr, 459 op/s 2024-09-19T08:50:26.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:25 smithi162 ceph-mon[34870]: pgmap v503: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.1 MiB/s wr, 459 op/s 2024-09-19T08:50:26.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:25 smithi018 ceph-mon[30956]: pgmap v503: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.1 MiB/s wr, 459 op/s 2024-09-19T08:50:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:27 smithi150 ceph-mon[34610]: pgmap v504: 129 pgs: 129 active+clean; 39 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.9 MiB/s wr, 413 op/s 2024-09-19T08:50:28.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:27 smithi162 ceph-mon[34870]: pgmap v504: 129 pgs: 129 active+clean; 39 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.9 MiB/s wr, 413 op/s 2024-09-19T08:50:28.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:27 smithi018 ceph-mon[30956]: pgmap v504: 129 pgs: 129 active+clean; 39 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.9 MiB/s wr, 413 op/s 2024-09-19T08:50:29.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:29 smithi162 ceph-mon[34870]: pgmap v505: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 3.3 MiB/s wr, 487 op/s 2024-09-19T08:50:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:29 smithi150 ceph-mon[34610]: pgmap v505: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 3.3 MiB/s wr, 487 op/s 2024-09-19T08:50:30.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:29 smithi018 ceph-mon[30956]: pgmap v505: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 3.3 MiB/s wr, 487 op/s 2024-09-19T08:50:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:31 smithi150 ceph-mon[34610]: pgmap v506: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.4 MiB/s wr, 459 op/s 2024-09-19T08:50:32.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:31 smithi162 ceph-mon[34870]: pgmap v506: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.4 MiB/s wr, 459 op/s 2024-09-19T08:50:32.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:31 smithi018 ceph-mon[30956]: pgmap v506: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.4 MiB/s wr, 459 op/s 2024-09-19T08:50:33.933 INFO:tasks.workunit.client.0.smithi018.stdout:All 50000 operations completed A-OK! 2024-09-19T08:50:33.934 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-19T08:50:33.934 INFO:tasks.workunit.client.0.smithi018.stdout:Seed set to 1 2024-09-19T08:50:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:33 smithi150 ceph-mon[34610]: pgmap v507: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.5 MiB/s wr, 497 op/s 2024-09-19T08:50:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:33 smithi162 ceph-mon[34870]: pgmap v507: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.5 MiB/s wr, 497 op/s 2024-09-19T08:50:34.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:33 smithi018 ceph-mon[30956]: pgmap v507: 129 pgs: 129 active+clean; 43 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.5 MiB/s wr, 497 op/s 2024-09-19T08:50:35.140 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T08:50:35.140 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T08:50:35.140 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T08:50:35.140 INFO:tasks.workunit.client.0.smithi018.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T08:50:35.143 INFO:tasks.workunit.client.0.smithi018.stdout:skipping zero size read 2024-09-19T08:50:35.155 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0x1c37b90 2024-09-19T08:50:35.163 INFO:tasks.workunit.client.0.smithi018.stdout:truncating to largest ever: 0x5bd330d 2024-09-19T08:50:35.181 INFO:tasks.workunit.client.0.smithi018.stdout:copying to largest ever: 0x637bf99 2024-09-19T08:50:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 -- 172.21.15.18:0/2013495579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408102d50 msgr2=0x7f64081031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 --2- 172.21.15.18:0/2013495579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408102d50 0x7f64081031d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009900 tx=0x7f63fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:50:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 -- 172.21.15.18:0/2013495579 shutdown_connections 2024-09-19T08:50:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 --2- 172.21.15.18:0/2013495579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408103710 0x7f6408109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 --2- 172.21.15.18:0/2013495579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408102d50 0x7f64081031d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 --2- 172.21.15.18:0/2013495579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 -- 172.21.15.18:0/2013495579 >> 172.21.15.18:0/2013495579 conn(0x7f64080fd2e0 msgr2=0x7f64080ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 -- 172.21.15.18:0/2013495579 shutdown_connections 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 -- 172.21.15.18:0/2013495579 wait complete. 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 Processor -- start 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.441+0000 7f640d65e640 1 -- start start 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f640d65e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f640d65e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408102d50 0x7f6408198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f640d65e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408103710 0x7f640819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f640d65e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f640810d6c0 con 0x7f6408101b60 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f640d65e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f640810d540 con 0x7f6408102d50 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f640d65e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f640810d840 con 0x7f6408103710 2024-09-19T08:50:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f64067fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408102d50 0x7f6408198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34260/0 (socket says 172.21.15.18:34260) 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 -- 172.21.15.18:0/3083948591 learned_addr learned my addr 172.21.15.18:0/3083948591 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f64077fe640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408103710 0x7f640819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 -- 172.21.15.18:0/3083948591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408103710 msgr2=0x7f640819f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408103710 0x7f640819f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 -- 172.21.15.18:0/3083948591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408102d50 msgr2=0x7f6408198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408102d50 0x7f6408198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 -- 172.21.15.18:0/3083948591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640819f960 con 0x7f6408101b60 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f64067fc640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408102d50 0x7f6408198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.442+0000 7f6406ffd640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408197d40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f63f800e9c0 tx=0x7f63f800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.443+0000 7f63effff640 1 -- 172.21.15.18:0/3083948591 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f800cd80 con 0x7f6408101b60 2024-09-19T08:50:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.443+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640819fc50 con 0x7f6408101b60 2024-09-19T08:50:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.443+0000 7f63effff640 1 -- 172.21.15.18:0/3083948591 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63f80035f0 con 0x7f6408101b60 2024-09-19T08:50:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.443+0000 7f63effff640 1 -- 172.21.15.18:0/3083948591 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8010690 con 0x7f6408101b60 2024-09-19T08:50:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.443+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64081a01c0 con 0x7f6408101b60 2024-09-19T08:50:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.446+0000 7f63effff640 1 -- 172.21.15.18:0/3083948591 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f63f80037a0 con 0x7f6408101b60 2024-09-19T08:50:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.447+0000 7f64103fb740 1 Processor -- start 2024-09-19T08:50:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.447+0000 7f64103fb740 1 -- start start 2024-09-19T08:50:35.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.447+0000 7f64103fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 0x563a4d66b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.447+0000 7f64103fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 0x563a4d6701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.447+0000 7f63effff640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f63f00a32f0 0x7f63f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 0x563a4d6701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 0x563a4d66b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 0x563a4d6701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47998/0 (socket says 172.21.15.18:47998) 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64103fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d670780 0x563a4d672c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 -- 172.21.15.18:0/2109477892 learned_addr learned my addr 172.21.15.18:0/2109477892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64077fe640 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 0x563a4d66b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34276/0 (socket says 172.21.15.18:34276) 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563a4d5ca2f0 con 0x563a4d66adb0 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563a4d572270 con 0x563a4d670780 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563a4d5c62b0 con 0x563a4d66b6f0 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64067fc640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f63f00a32f0 0x7f63f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f63effff640 1 -- 172.21.15.18:0/3083948591 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f63f80d0050 con 0x7f6408101b60 2024-09-19T08:50:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 -- 172.21.15.18:0/2109477892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d670780 msgr2=0x563a4d672c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d670780 0x563a4d672c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 -- 172.21.15.18:0/2109477892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 msgr2=0x563a4d66b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 0x563a4d66b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f6406ffd640 1 -- 172.21.15.18:0/2109477892 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4d571340 con 0x563a4d66b6f0 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.448+0000 7f64077fe640 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 0x563a4d66b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.449+0000 7f6406ffd640 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 0x563a4d6701b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63f8098c70 tx=0x7f63f809c120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c8908b9ff156b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.449+0000 7f64067fc640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f63f00a32f0 0x7f63f00a57b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0314e0 tx=0x7f63fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.449+0000 7f63ed7fa640 1 -- 172.21.15.18:0/2109477892 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f809c2a0 con 0x563a4d66b6f0 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.449+0000 7f63ed7fa640 1 -- 172.21.15.18:0/2109477892 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63f80ab040 con 0x563a4d66b6f0 2024-09-19T08:50:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.449+0000 7f63ed7fa640 1 -- 172.21.15.18:0/2109477892 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8098910 con 0x563a4d66b6f0 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 msgr2=0x563a4d6701b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 0x563a4d6701b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63f8098c70 tx=0x7f63f809c120 comp rx=0 tx=0).stop 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 shutdown_connections 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d670780 0x563a4d672c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66b6f0 0x563a4d6701b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 --2- 172.21.15.18:0/2109477892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66adb0 0x563a4d66b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 >> 172.21.15.18:0/2109477892 conn(0x563a4d666420 msgr2=0x563a4d666820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 shutdown_connections 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 -- 172.21.15.18:0/2109477892 wait complete. 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 -- start start 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.450+0000 7f64103fb740 1 Processor -- start 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d66e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d66f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563a4d661bd0 con 0x563a4d670780 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563a4d553290 con 0x563a4d66b6f0 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563a4d661d50 con 0x563a4d66adb0 2024-09-19T08:50:35.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:48014/0 (socket says 172.21.15.18:48014) 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 -- 172.21.15.18:0/4158174665 learned_addr learned my addr 172.21.15.18:0/4158174665 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64077fe640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d66f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64103fb740 10 client.0 _ll_register_callbacks cb 0x563a4d584140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f64067fc640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d66e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 -- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 msgr2=0x563a4d66e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d66e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 -- 172.21.15.18:0/4158174665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 msgr2=0x563a4d66f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d66f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 -- 172.21.15.18:0/4158174665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4d2dd210 con 0x563a4d66adb0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f6406ffd640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66de90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f63f80cd7d0 tx=0x7f63f8098630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ae221bc9ca996c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.451+0000 7f63eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f63eaff5640 1 -- 172.21.15.18:0/4158174665 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f809a340 con 0x563a4d66adb0 2024-09-19T08:50:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f63eaff5640 1 -- 172.21.15.18:0/4158174665 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f63f80a4c90 con 0x563a4d66adb0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f80ab040 con 0x563a4d66adb0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f63eaff5640 1 -- 172.21.15.18:0/4158174665 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f63f80b5220 con 0x563a4d66adb0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 10 client.25294 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563a4d3a9620 con 0x563a4d66adb0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f63eaff5640 1 -- 172.21.15.18:0/4158174665 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63f80ab040 con 0x563a4d66adb0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f63eaff5640 1 -- 172.21.15.18:0/4158174665 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63f80ac140 con 0x563a4d66adb0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 10 client.25294 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 10 client.25294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 20 client.25294 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d67c4b0 0x563a4d67e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 4 client.25294 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.452+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a4d5d7a20 con 0x563a4d67c4b0 2024-09-19T08:50:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.453+0000 7f64067fc640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d67c4b0 0x563a4d67e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.453+0000 7f63eaff5640 10 client.25294 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.453+0000 7f64067fc640 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d67c4b0 0x563a4d67e8a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab4ea506c339be0 server_cookie=341403794b90e657 in_seq=0 out_seq=0 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f63eaff5640 1 -- 172.21.15.18:0/4158174665 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a4d5d7a20 con 0x563a4d67c4b0 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f63eaff5640 10 client.25294 handle_command_reply: tid=0 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 client.25294 shutdown 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 msgr2=0x563a4d66de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66de90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f63f80cd7d0 tx=0x7f63f8098630 comp rx=0 tx=0).stop 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 shutdown_connections 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d67c4b0 0x563a4d67e8a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d66f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d66e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f63eaff5640 0 client.25294 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 --2- 172.21.15.18:0/4158174665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66de90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 >> 172.21.15.18:0/4158174665 conn(0x563a4d666420 msgr2=0x563a4d6611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 shutdown_connections 2024-09-19T08:50:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 1 -- 172.21.15.18:0/4158174665 wait complete. 2024-09-19T08:50:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.454+0000 7f64103fb740 20 client.25294 trim_cache size 0 max 16384 2024-09-19T08:50:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 Processor -- start 2024-09-19T08:50:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 -- start start 2024-09-19T08:50:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d666800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d666d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a6620 con 0x563a4d670780 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a8ea0 con 0x563a4d66b6f0 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64103fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a6c90 con 0x563a4d66adb0 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d666d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:48026/0 (socket says 172.21.15.18:48026) 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64067fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d666800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f6406ffd640 1 -- 172.21.15.18:0/860849326 learned_addr learned my addr 172.21.15.18:0/860849326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64077fe640 1 -- 172.21.15.18:0/860849326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 msgr2=0x563a4d66e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64077fe640 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64077fe640 1 -- 172.21.15.18:0/860849326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 msgr2=0x563a4d666800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64077fe640 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d666800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64077fe640 1 -- 172.21.15.18:0/860849326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4d665e20 con 0x563a4d670780 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f64067fc640 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d666800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.479+0000 7f6406ffd640 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.480+0000 7f64077fe640 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d666d40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6400003a20 tx=0x7f6400003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a9cca3e4cf6b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.480+0000 7f63ecff9640 1 -- 172.21.15.18:0/860849326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400020070 con 0x563a4d670780 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.480+0000 7f63ecff9640 1 -- 172.21.15.18:0/860849326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f64000108e0 con 0x563a4d670780 2024-09-19T08:50:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.480+0000 7f63ecff9640 1 -- 172.21.15.18:0/860849326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640001b960 con 0x563a4d670780 2024-09-19T08:50:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 -- 172.21.15.18:0/860849326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 msgr2=0x563a4d666d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d666d40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6400003a20 tx=0x7f6400003ee0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 -- 172.21.15.18:0/860849326 shutdown_connections 2024-09-19T08:50:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d670780 0x563a4d666d40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66b6f0 0x563a4d666800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 --2- 172.21.15.18:0/860849326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d66adb0 0x563a4d66e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 -- 172.21.15.18:0/860849326 >> 172.21.15.18:0/860849326 conn(0x563a4d666420 msgr2=0x563a4d6611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 -- 172.21.15.18:0/860849326 shutdown_connections 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 -- 172.21.15.18:0/860849326 wait complete. 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 -- start start 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.481+0000 7f64103fb740 1 Processor -- start 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66adb0 0x563a4d6764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66b6f0 0x563a4d676a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d670780 0x563a4d6779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a7360 con 0x563a4d66b6f0 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a87d0 con 0x563a4d66adb0 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a7a30 con 0x563a4d670780 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64103fb740 10 client.0 _ll_register_callbacks cb 0x7f63f80046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64067fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66b6f0 0x563a4d676a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64077fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d670780 0x563a4d6779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64067fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66b6f0 0x563a4d676a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34296/0 (socket says 172.21.15.18:34296) 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66adb0 0x563a4d6764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64067fc640 1 -- 172.21.15.18:0/1680205239 learned_addr learned my addr 172.21.15.18:0/1680205239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f64077fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d670780 0x563a4d6779d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:48036/0 (socket says 172.21.15.18:48036) 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 -- 172.21.15.18:0/1680205239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d670780 msgr2=0x563a4d6779d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d670780 0x563a4d6779d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 -- 172.21.15.18:0/1680205239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66b6f0 msgr2=0x563a4d676a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66b6f0 0x563a4d676a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 -- 172.21.15.18:0/1680205239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4d677fe0 con 0x563a4d66adb0 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f6406ffd640 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66adb0 0x563a4d6764d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63f8098c70 tx=0x7f63f809bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62a24b698fbbe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.482+0000 7f63eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f63eaff5640 1 -- 172.21.15.18:0/1680205239 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f809c070 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f63eaff5640 1 -- 172.21.15.18:0/1680205239 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f63f809a340 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64000108e0 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f63eaff5640 1 -- 172.21.15.18:0/1680205239 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f63f80a4f10 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 10 client.25211 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563a4d6792f0 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f63eaff5640 1 -- 172.21.15.18:0/1680205239 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f64000108e0 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f63eaff5640 1 -- 172.21.15.18:0/1680205239 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63f80a9070 con 0x563a4d66adb0 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 10 client.25211 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 10 client.25211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 20 client.25211 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d6e71f0 0x563a4d6e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 4 client.25211 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:50:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a4d5d1d70 con 0x563a4d6e71f0 2024-09-19T08:50:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.483+0000 7f64067fc640 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d6e71f0 0x563a4d6e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.484+0000 7f63eaff5640 10 client.25211 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.484+0000 7f64067fc640 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d6e71f0 0x563a4d6e95e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dbd7a7a6e736d40 server_cookie=eb387e5b67011c5d in_seq=0 out_seq=0 2024-09-19T08:50:35.495 INFO:tasks.workunit.client.0.smithi018.stdout:copying to largest ever: 0x63d9b9c 2024-09-19T08:50:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.500+0000 7f63eaff5640 1 -- 172.21.15.18:0/1680205239 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a4d5d1d70 con 0x563a4d6e71f0 2024-09-19T08:50:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.500+0000 7f63eaff5640 10 client.25211 handle_command_reply: tid=0 2024-09-19T08:50:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.500+0000 7f64103fb740 1 client.25211 shutdown 2024-09-19T08:50:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.500+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66adb0 msgr2=0x563a4d6764d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.500+0000 7f64103fb740 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66adb0 0x563a4d6764d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63f8098c70 tx=0x7f63f809bc00 comp rx=0 tx=0).stop 2024-09-19T08:50:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.502+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 shutdown_connections 2024-09-19T08:50:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.502+0000 7f64103fb740 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x563a4d6e71f0 0x563a4d6e95e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.502+0000 7f64103fb740 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563a4d670780 0x563a4d6779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.502+0000 7f64103fb740 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4d66b6f0 0x563a4d676a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.502+0000 7f64103fb740 1 --2- 172.21.15.18:0/1680205239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a4d66adb0 0x563a4d6764d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.502+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 >> 172.21.15.18:0/1680205239 conn(0x563a4d666420 msgr2=0x563a4d66c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.503+0000 7f63eaff5640 0 client.25211 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.503+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 shutdown_connections 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.503+0000 7f64103fb740 1 -- 172.21.15.18:0/1680205239 wait complete. 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.503+0000 7f64103fb740 20 client.25211 trim_cache size 0 max 16384 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:50:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:50:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.507+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f63f00a32f0 msgr2=0x7f63f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.507+0000 7f640d65e640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f63f00a32f0 0x7f63f00a57b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0314e0 tx=0x7f63fc005a20 comp rx=0 tx=0).stop 2024-09-19T08:50:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.507+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 msgr2=0x7f6408197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.507+0000 7f640d65e640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408197d40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f63f800e9c0 tx=0x7f63f800ee80 comp rx=0 tx=0).stop 2024-09-19T08:50:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.508+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 shutdown_connections 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.508+0000 7f640d65e640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f63f00a32f0 0x7f63f00a57b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.508+0000 7f640d65e640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6408103710 0x7f640819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.508+0000 7f640d65e640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6408102d50 0x7f6408198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.508+0000 7f640d65e640 1 --2- 172.21.15.18:0/3083948591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6408101b60 0x7f6408197d40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.508+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 >> 172.21.15.18:0/3083948591 conn(0x7f64080fd2e0 msgr2=0x7f64081060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.509+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 shutdown_connections 2024-09-19T08:50:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:35.509+0000 7f640d65e640 1 -- 172.21.15.18:0/3083948591 wait complete. 2024-09-19T08:50:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:35 smithi150 ceph-mon[34610]: pgmap v508: 129 pgs: 129 active+clean; 43 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-09-19T08:50:36.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:35 smithi162 ceph-mon[34870]: pgmap v508: 129 pgs: 129 active+clean; 43 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-09-19T08:50:36.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:35 smithi018 ceph-mon[30956]: pgmap v508: 129 pgs: 129 active+clean; 43 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-09-19T08:50:37.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:37 smithi018 ceph-mon[30956]: pgmap v509: 129 pgs: 129 active+clean; 47 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 3.0 MiB/s wr, 397 op/s 2024-09-19T08:50:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:37 smithi150 ceph-mon[34610]: pgmap v509: 129 pgs: 129 active+clean; 47 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 3.0 MiB/s wr, 397 op/s 2024-09-19T08:50:38.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:37 smithi162 ceph-mon[34870]: pgmap v509: 129 pgs: 129 active+clean; 47 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 3.0 MiB/s wr, 397 op/s 2024-09-19T08:50:40.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:39 smithi150 ceph-mon[34610]: pgmap v510: 129 pgs: 129 active+clean; 46 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.0 MiB/s wr, 437 op/s 2024-09-19T08:50:40.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:39 smithi162 ceph-mon[34870]: pgmap v510: 129 pgs: 129 active+clean; 46 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.0 MiB/s wr, 437 op/s 2024-09-19T08:50:40.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:39 smithi018 ceph-mon[30956]: pgmap v510: 129 pgs: 129 active+clean; 46 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.0 MiB/s wr, 437 op/s 2024-09-19T08:50:42.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:41 smithi150 ceph-mon[34610]: pgmap v511: 129 pgs: 129 active+clean; 55 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.9 MiB/s wr, 460 op/s 2024-09-19T08:50:42.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:41 smithi162 ceph-mon[34870]: pgmap v511: 129 pgs: 129 active+clean; 55 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.9 MiB/s wr, 460 op/s 2024-09-19T08:50:42.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:41 smithi018 ceph-mon[30956]: pgmap v511: 129 pgs: 129 active+clean; 55 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.9 MiB/s wr, 460 op/s 2024-09-19T08:50:42.428 INFO:tasks.workunit.client.0.smithi018.stdout:copying to largest ever: 0x63ee1da 2024-09-19T08:50:44.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:43 smithi150 ceph-mon[34610]: pgmap v512: 129 pgs: 129 active+clean; 64 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.8 MiB/s wr, 522 op/s 2024-09-19T08:50:44.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:43 smithi162 ceph-mon[34870]: pgmap v512: 129 pgs: 129 active+clean; 64 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.8 MiB/s wr, 522 op/s 2024-09-19T08:50:44.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:43 smithi018 ceph-mon[30956]: pgmap v512: 129 pgs: 129 active+clean; 64 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.8 MiB/s wr, 522 op/s 2024-09-19T08:50:46.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:45 smithi150 ceph-mon[34610]: pgmap v513: 129 pgs: 129 active+clean; 65 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.3 MiB/s wr, 447 op/s 2024-09-19T08:50:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:45 smithi162 ceph-mon[34870]: pgmap v513: 129 pgs: 129 active+clean; 65 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.3 MiB/s wr, 447 op/s 2024-09-19T08:50:46.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:45 smithi018 ceph-mon[30956]: pgmap v513: 129 pgs: 129 active+clean; 65 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.3 MiB/s wr, 447 op/s 2024-09-19T08:50:48.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:47 smithi150 ceph-mon[34610]: pgmap v514: 129 pgs: 129 active+clean; 66 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 547 op/s 2024-09-19T08:50:48.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:47 smithi162 ceph-mon[34870]: pgmap v514: 129 pgs: 129 active+clean; 66 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 547 op/s 2024-09-19T08:50:48.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:47 smithi018 ceph-mon[30956]: pgmap v514: 129 pgs: 129 active+clean; 66 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 547 op/s 2024-09-19T08:50:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/254375768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb081025f0 msgr2=0x7ffb08108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/254375768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb081025f0 0x7ffb08108e80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009ca0 tx=0x7ffb0002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/254375768 shutdown_connections 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/254375768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb081025f0 0x7ffb08108e80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/254375768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb08101c30 0x7ffb081020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/254375768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb08100a40 0x7ffb08100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.632+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/254375768 >> 172.21.15.18:0/254375768 conn(0x7ffb080fc1e0 msgr2=0x7ffb080fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.633+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/254375768 shutdown_connections 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.633+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/254375768 wait complete. 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.633+0000 7ffb0fbfd640 1 Processor -- start 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.633+0000 7ffb0fbfd640 1 -- start start 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0fbfd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 0x7ffb08197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0fbfd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb08101c30 0x7ffb081981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0fbfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb081025f0 0x7ffb0819f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0fbfd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0810c550 con 0x7ffb08100a40 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0fbfd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0810c3d0 con 0x7ffb08101c30 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0fbfd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0810c6d0 con 0x7ffb081025f0 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 0x7ffb08197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 0x7ffb08197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40580/0 (socket says 172.21.15.18:40580) 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 -- 172.21.15.18:0/3494038327 learned_addr learned my addr 172.21.15.18:0/3494038327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0e19a640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb081025f0 0x7ffb0819f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d198640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb08101c30 0x7ffb081981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 -- 172.21.15.18:0/3494038327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb081025f0 msgr2=0x7ffb0819f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb081025f0 0x7ffb0819f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 -- 172.21.15.18:0/3494038327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb08101c30 msgr2=0x7ffb081981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb08101c30 0x7ffb081981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 -- 172.21.15.18:0/3494038327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0819f8b0 con 0x7ffb08100a40 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0e19a640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb081025f0 0x7ffb0819f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.634+0000 7ffb0d999640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 0x7ffb08197c70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9c0 tx=0x7ffb0400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.635+0000 7ffafeffd640 1 -- 172.21.15.18:0/3494038327 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400cd80 con 0x7ffb08100a40 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.635+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb08102eb0 con 0x7ffb08100a40 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.635+0000 7ffafeffd640 1 -- 172.21.15.18:0/3494038327 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb040035f0 con 0x7ffb08100a40 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.635+0000 7ffafeffd640 1 -- 172.21.15.18:0/3494038327 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04010690 con 0x7ffb08100a40 2024-09-19T08:50:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.635+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb08103450 con 0x7ffb08100a40 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.637+0000 7ffafeffd640 1 -- 172.21.15.18:0/3494038327 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffb040037a0 con 0x7ffb08100a40 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 Processor -- start 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 -- start start 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc39a0 0x561e21fc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fc8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fcb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561e21f272f0 con 0x561e21fc39a0 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561e21ecf270 con 0x561e21fc9370 2024-09-19T08:50:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e21f232b0 con 0x561e21fc42e0 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fc8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb0e19a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc39a0 0x561e21fc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.638+0000 7ffb0d198640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fcb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fc8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40454/0 (socket says 172.21.15.18:40454) 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 -- 172.21.15.18:0/827364103 learned_addr learned my addr 172.21.15.18:0/827364103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffafeffd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ffaf40a32f0 0x7ffaf40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 -- 172.21.15.18:0/827364103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 msgr2=0x561e21fcb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fcb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 -- 172.21.15.18:0/827364103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc39a0 msgr2=0x561e21fc3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc39a0 0x561e21fc3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 -- 172.21.15.18:0/827364103 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e21ece340 con 0x561e21fc42e0 2024-09-19T08:50:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0e19a640 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc39a0 0x561e21fc3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0e19a640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ffaf40a32f0 0x7ffaf40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffafeffd640 1 -- 172.21.15.18:0/3494038327 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ffb040d0080 con 0x7ffb08100a40 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0d999640 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fc8da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb0408eb70 tx=0x7ffb040917b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d996352ac2a3cf1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffaf3fff640 1 -- 172.21.15.18:0/827364103 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0409be10 con 0x561e21fc42e0 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffaf3fff640 1 -- 172.21.15.18:0/827364103 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb04003b30 con 0x561e21fc42e0 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffaf3fff640 1 -- 172.21.15.18:0/827364103 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0408a0c0 con 0x561e21fc42e0 2024-09-19T08:50:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.639+0000 7ffb0e19a640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ffaf40a32f0 0x7ffaf40a57b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005e30 tx=0x7ffb0003e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.640+0000 7ffb12a7f740 1 -- 172.21.15.18:0/827364103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 msgr2=0x561e21fc8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.640+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fc8da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb0408eb70 tx=0x7ffb040917b0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 -- 172.21.15.18:0/827364103 shutdown_connections 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fcb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fc8da0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/827364103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc39a0 0x561e21fc3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 -- 172.21.15.18:0/827364103 >> 172.21.15.18:0/827364103 conn(0x561e21fbf010 msgr2=0x561e21fbf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 -- 172.21.15.18:0/827364103 shutdown_connections 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 -- 172.21.15.18:0/827364103 wait complete. 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 -- start start 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.641+0000 7ffb12a7f740 1 Processor -- start 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 0x561e21fcdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fd5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561e21fcc2e0 con 0x561e21fc42e0 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561e21eb0290 con 0x561e21fc9370 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e21fcc460 con 0x561e21fc39a0 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb12a7f740 10 client.0 _ll_register_callbacks cb 0x561e21ee1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 0x561e21fcdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0e19a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fd5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40586/0 (socket says 172.21.15.18:40586) 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 0x561e21fcdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40470/0 (socket says 172.21.15.18:40470) 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 -- 172.21.15.18:0/233450832 learned_addr learned my addr 172.21.15.18:0/233450832 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 -- 172.21.15.18:0/233450832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 msgr2=0x561e21fcdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 0x561e21fcdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 -- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 msgr2=0x561e21fd5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fd5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 -- 172.21.15.18:0/233450832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e21c3a210 con 0x561e21fc42e0 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d999640 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 0x561e21fcdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffb0d198640 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fce040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8012720 tx=0x7ffaf8012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ea43ef047db2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.642+0000 7ffaf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.643+0000 7ffaf17fa640 1 -- 172.21.15.18:0/233450832 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800f920 con 0x561e21fc42e0 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.643+0000 7ffaf17fa640 1 -- 172.21.15.18:0/233450832 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ffaf800fac0 con 0x561e21fc42e0 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.643+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e21f34a20 con 0x561e21fc42e0 2024-09-19T08:50:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.643+0000 7ffaf17fa640 1 -- 172.21.15.18:0/233450832 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffaf800fcc0 con 0x561e21fc42e0 2024-09-19T08:50:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.645+0000 7ffb12a7f740 10 client.15591 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.645+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561e21d06620 con 0x561e21fc42e0 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffaf17fa640 1 -- 172.21.15.18:0/233450832 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffaf8004c50 con 0x561e21fc42e0 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffaf17fa640 1 -- 172.21.15.18:0/233450832 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffaf8005560 con 0x561e21fc42e0 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffb12a7f740 10 client.15591 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffb12a7f740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffb12a7f740 20 client.15591 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e21fd9710 0x561e21fdbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffb12a7f740 4 client.15591 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.646+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e21f34a20 con 0x561e21fd9710 2024-09-19T08:50:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.647+0000 7ffb0d999640 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e21fd9710 0x561e21fdbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.649+0000 7ffb0d999640 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e21fd9710 0x561e21fdbb00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1568f01463303b0a server_cookie=40df336877d45d33 in_seq=0 out_seq=0 2024-09-19T08:50:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.649+0000 7ffaf17fa640 10 client.15591 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.651+0000 7ffaf17fa640 1 -- 172.21.15.18:0/233450832 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e21f34a20 con 0x561e21fd9710 2024-09-19T08:50:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.651+0000 7ffaf17fa640 10 client.15591 handle_command_reply: tid=0 2024-09-19T08:50:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.651+0000 7ffb12a7f740 1 client.15591 shutdown 2024-09-19T08:50:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.652+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 msgr2=0x561e21fce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.652+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fce040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8012720 tx=0x7ffaf8012be0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.652+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 shutdown_connections 2024-09-19T08:50:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.653+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e21fd9710 0x561e21fdbb00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.653+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc9370 0x561e21fd5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.653+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fce040 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.653+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/233450832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc39a0 0x561e21fcdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.653+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 >> 172.21.15.18:0/233450832 conn(0x561e21fbf010 msgr2=0x561e21fc0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.654+0000 7ffaf17fa640 0 client.15591 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.654+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 shutdown_connections 2024-09-19T08:50:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.654+0000 7ffb12a7f740 1 -- 172.21.15.18:0/233450832 wait complete. 2024-09-19T08:50:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.654+0000 7ffb12a7f740 20 client.15591 trim_cache size 0 max 16384 2024-09-19T08:50:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 Processor -- start 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 -- start start 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fcc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fd5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc9370 0x561e21fbe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081a6650 con 0x561e21fc42e0 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081a8ed0 con 0x561e21fc39a0 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081a6cc0 con 0x561e21fc9370 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb0d198640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fd5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fcc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb0d198640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fd5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40598/0 (socket says 172.21.15.18:40598) 2024-09-19T08:50:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.672+0000 7ffb0d198640 1 -- 172.21.15.18:0/755982884 learned_addr learned my addr 172.21.15.18:0/755982884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0e19a640 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc9370 0x561e21fbe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d999640 1 -- 172.21.15.18:0/755982884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc9370 msgr2=0x561e21fbe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d999640 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc9370 0x561e21fbe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d999640 1 -- 172.21.15.18:0/755982884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 msgr2=0x561e21fd5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d999640 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fd5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d999640 1 -- 172.21.15.18:0/755982884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e21fbee30 con 0x561e21fc39a0 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d198640 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fd5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffb0d999640 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fcc800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb0409bfd0 tx=0x7ffb040917b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c788ab049fcd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffaf37fe640 1 -- 172.21.15.18:0/755982884 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0406efb0 con 0x561e21fc39a0 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffaf37fe640 1 -- 172.21.15.18:0/755982884 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb0409c2d0 con 0x561e21fc39a0 2024-09-19T08:50:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.673+0000 7ffaf37fe640 1 -- 172.21.15.18:0/755982884 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb040652d0 con 0x561e21fc39a0 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 -- 172.21.15.18:0/755982884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 msgr2=0x561e21fcc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fcc800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb0409bfd0 tx=0x7ffb040917b0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 -- 172.21.15.18:0/755982884 shutdown_connections 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc9370 0x561e21fbe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc42e0 0x561e21fd5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/755982884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fcc800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 -- 172.21.15.18:0/755982884 >> 172.21.15.18:0/755982884 conn(0x561e21fbf010 msgr2=0x561e21fbd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 -- 172.21.15.18:0/755982884 shutdown_connections 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 -- 172.21.15.18:0/755982884 wait complete. 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.674+0000 7ffb12a7f740 1 -- start start 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 Processor -- start 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fd21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fd26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc9370 0x561e21fd36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081a7390 con 0x561e21fc9370 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081a8800 con 0x561e21fc39a0 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081a7a60 con 0x561e21fc42e0 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb12a7f740 10 client.0 _ll_register_callbacks cb 0x7ffaf8009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fd21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb0e19a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc9370 0x561e21fd36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb0d999640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fd21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:40538/0 (socket says 172.21.15.18:40538) 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb0d999640 1 -- 172.21.15.18:0/273889609 learned_addr learned my addr 172.21.15.18:0/273889609 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.675+0000 7ffb0d198640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fd26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d999640 1 -- 172.21.15.18:0/273889609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 msgr2=0x561e21fd26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d999640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fd26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d999640 1 -- 172.21.15.18:0/273889609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc9370 msgr2=0x561e21fd36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d999640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc9370 0x561e21fd36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d999640 1 -- 172.21.15.18:0/273889609 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e21fd3cc0 con 0x561e21fc39a0 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d198640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fd26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb0d999640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fd21b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb0409c260 tx=0x7ffb040d0400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c377da70d82be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffaf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:50:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffaf17fa640 1 -- 172.21.15.18:0/273889609 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0409bc30 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffaf17fa640 1 -- 172.21.15.18:0/273889609 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ffb0409a5d0 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0409c2d0 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffaf17fa640 1 -- 172.21.15.18:0/273889609 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb040a4ab0 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb12a7f740 10 client.25229 fetch_fsmap learned FSMap version 21 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561e21fd4fd0 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffaf17fa640 1 -- 172.21.15.18:0/273889609 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb0409c2d0 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.676+0000 7ffaf17fa640 1 -- 172.21.15.18:0/273889609 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffb040bc0b0 con 0x561e21fc39a0 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb12a7f740 10 client.25229 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb12a7f740 10 client.25229 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb12a7f740 20 client.25229 populate_metadata read hostname 'smithi018' 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e220443e0 0x561e220467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb12a7f740 4 client.25229 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:50:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e21f2ed70 con 0x561e220443e0 2024-09-19T08:50:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb0d198640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e220443e0 0x561e220467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffaf17fa640 10 client.25229 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.677+0000 7ffb0d198640 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e220443e0 0x561e220467d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12b89771dede440 server_cookie=25884a1e17537078 in_seq=0 out_seq=0 2024-09-19T08:50:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.695+0000 7ffaf17fa640 1 -- 172.21.15.18:0/273889609 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e21f2ed70 con 0x561e220443e0 2024-09-19T08:50:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.695+0000 7ffaf17fa640 10 client.25229 handle_command_reply: tid=0 2024-09-19T08:50:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.696+0000 7ffb12a7f740 1 client.25229 shutdown 2024-09-19T08:50:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.696+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 msgr2=0x561e21fd21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.696+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fd21b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb0409c260 tx=0x7ffb040d0400 comp rx=0 tx=0).stop 2024-09-19T08:50:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.696+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 shutdown_connections 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.696+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x561e220443e0 0x561e220467d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffaf17fa640 0 client.25229 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e21fc9370 0x561e21fd36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e21fc42e0 0x561e21fd26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffb12a7f740 1 --2- 172.21.15.18:0/273889609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e21fc39a0 0x561e21fd21b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 >> 172.21.15.18:0/273889609 conn(0x561e21fbf010 msgr2=0x561e21fbe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 shutdown_connections 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.697+0000 7ffb12a7f740 1 -- 172.21.15.18:0/273889609 wait complete. 2024-09-19T08:50:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.698+0000 7ffb12a7f740 20 client.25229 trim_cache size 0 max 16384 2024-09-19T08:50:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:50:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:50:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:50:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ffaf40a32f0 msgr2=0x7ffaf40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ffaf40a32f0 0x7ffaf40a57b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005e30 tx=0x7ffb0003e040 comp rx=0 tx=0).stop 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 msgr2=0x7ffb08197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 0x7ffb08197c70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9c0 tx=0x7ffb0400ee80 comp rx=0 tx=0).stop 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 shutdown_connections 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ffaf40a32f0 0x7ffaf40a57b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb081025f0 0x7ffb0819f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb08101c30 0x7ffb081981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 --2- 172.21.15.18:0/3494038327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb08100a40 0x7ffb08197c70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.699+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 >> 172.21.15.18:0/3494038327 conn(0x7ffb080fc1e0 msgr2=0x7ffb080fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.700+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 shutdown_connections 2024-09-19T08:50:48.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:50:48.700+0000 7ffb0fbfd640 1 -- 172.21.15.18:0/3494038327 wait complete. 2024-09-19T08:50:50.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:49 smithi150 ceph-mon[34610]: pgmap v515: 129 pgs: 129 active+clean; 70 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.6 MiB/s wr, 608 op/s 2024-09-19T08:50:50.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:49 smithi162 ceph-mon[34870]: pgmap v515: 129 pgs: 129 active+clean; 70 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.6 MiB/s wr, 608 op/s 2024-09-19T08:50:50.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:49 smithi018 ceph-mon[30956]: pgmap v515: 129 pgs: 129 active+clean; 70 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.6 MiB/s wr, 608 op/s 2024-09-19T08:50:52.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:51 smithi150 ceph-mon[34610]: pgmap v516: 129 pgs: 129 active+clean; 73 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 686 op/s 2024-09-19T08:50:52.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:51 smithi162 ceph-mon[34870]: pgmap v516: 129 pgs: 129 active+clean; 73 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 686 op/s 2024-09-19T08:50:52.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:51 smithi018 ceph-mon[30956]: pgmap v516: 129 pgs: 129 active+clean; 73 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 686 op/s 2024-09-19T08:50:54.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:53 smithi150 ceph-mon[34610]: pgmap v517: 129 pgs: 129 active+clean; 70 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.9 MiB/s wr, 696 op/s 2024-09-19T08:50:54.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:53 smithi162 ceph-mon[34870]: pgmap v517: 129 pgs: 129 active+clean; 70 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.9 MiB/s wr, 696 op/s 2024-09-19T08:50:54.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:53 smithi018 ceph-mon[30956]: pgmap v517: 129 pgs: 129 active+clean; 70 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.9 MiB/s wr, 696 op/s 2024-09-19T08:50:55.643 INFO:tasks.workunit.client.0.smithi018.stdout:10000 write 0x4c35901 thru 0x4c3d40f (0x7b0f bytes) 2024-09-19T08:50:56.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:55 smithi150 ceph-mon[34610]: pgmap v518: 129 pgs: 129 active+clean; 73 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 603 op/s 2024-09-19T08:50:56.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:55 smithi162 ceph-mon[34870]: pgmap v518: 129 pgs: 129 active+clean; 73 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 603 op/s 2024-09-19T08:50:56.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:55 smithi018 ceph-mon[30956]: pgmap v518: 129 pgs: 129 active+clean; 73 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 603 op/s 2024-09-19T08:50:58.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:57 smithi150 ceph-mon[34610]: pgmap v519: 129 pgs: 129 active+clean; 57 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.2 MiB/s wr, 719 op/s 2024-09-19T08:50:58.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:57 smithi162 ceph-mon[34870]: pgmap v519: 129 pgs: 129 active+clean; 57 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.2 MiB/s wr, 719 op/s 2024-09-19T08:50:58.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:57 smithi018 ceph-mon[30956]: pgmap v519: 129 pgs: 129 active+clean; 57 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.2 MiB/s wr, 719 op/s 2024-09-19T08:51:00.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:50:59 smithi150 ceph-mon[34610]: pgmap v520: 129 pgs: 129 active+clean; 59 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.6 MiB/s wr, 623 op/s 2024-09-19T08:51:00.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:50:59 smithi162 ceph-mon[34870]: pgmap v520: 129 pgs: 129 active+clean; 59 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.6 MiB/s wr, 623 op/s 2024-09-19T08:51:00.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:50:59 smithi018 ceph-mon[30956]: pgmap v520: 129 pgs: 129 active+clean; 59 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.6 MiB/s wr, 623 op/s 2024-09-19T08:51:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 -- 172.21.15.18:0/3884043346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 msgr2=0x7f2cf01020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/3884043346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf01020c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009900 tx=0x7f2ce402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 -- 172.21.15.18:0/3884043346 shutdown_connections 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/3884043346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf0102600 0x7f2cf0108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/3884043346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf01020c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/3884043346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 0x7f2cf0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 -- 172.21.15.18:0/3884043346 >> 172.21.15.18:0/3884043346 conn(0x7f2cf00fc1b0 msgr2=0x7f2cf00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 -- 172.21.15.18:0/3884043346 shutdown_connections 2024-09-19T08:51:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 -- 172.21.15.18:0/3884043346 wait complete. 2024-09-19T08:51:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.825+0000 7f2cf4f11640 1 Processor -- start 2024-09-19T08:51:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 -- start start 2024-09-19T08:51:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 0x7f2cf006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf0102600 0x7f2cf019f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010c5d0 con 0x7f2cf0101c40 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010c450 con 0x7f2cf0100a50 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cf4f11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010c750 con 0x7f2cf0102600 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41006/0 (socket says 172.21.15.18:41006) 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 -- 172.21.15.18:0/1303498862 learned_addr learned my addr 172.21.15.18:0/1303498862 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cee59c640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 0x7f2cf006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf0102600 0x7f2cf019f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 -- 172.21.15.18:0/1303498862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf0102600 msgr2=0x7f2cf019f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf0102600 0x7f2cf019f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 -- 172.21.15.18:0/1303498862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 msgr2=0x7f2cf006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 0x7f2cf006ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 -- 172.21.15.18:0/1303498862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf019f980 con 0x7f2cf0101c40 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cee59c640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 0x7f2cf006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.826+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf019ca50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40314e0 tx=0x7f2ce4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.827+0000 7f2cdf7fe640 1 -- 172.21.15.18:0/1303498862 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce403f070 con 0x7f2cf0101c40 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.827+0000 7f2cdf7fe640 1 -- 172.21.15.18:0/1303498862 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ce4031c40 con 0x7f2cf0101c40 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.827+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf019fbb0 con 0x7f2cf0101c40 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.827+0000 7f2cdf7fe640 1 -- 172.21.15.18:0/1303498862 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4035030 con 0x7f2cf0101c40 2024-09-19T08:51:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.827+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf01a00a0 con 0x7f2cf0101c40 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.829+0000 7f2cdf7fe640 1 -- 172.21.15.18:0/1303498862 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2ce4042070 con 0x7f2cf0101c40 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.830+0000 7f2cdf7fe640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2cd80a32f0 0x7f2cd80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.830+0000 7f2cf7ca7740 1 Processor -- start 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.830+0000 7f2cdf7fe640 1 -- 172.21.15.18:0/1303498862 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2ce40f0400 con 0x7f2cf0101c40 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.830+0000 7f2cee59c640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2cd80a32f0 0x7f2cd80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.830+0000 7f2cf7ca7740 1 -- start start 2024-09-19T08:51:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a31920 0x55c5f4a31d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a34d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 0x55c5f4a422e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5f49952f0 con 0x55c5f4a31920 2024-09-19T08:51:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c5f493d270 con 0x55c5f4a35330 2024-09-19T08:51:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c5f49912b0 con 0x55c5f4a32260 2024-09-19T08:51:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 0x55c5f4a422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 0x55c5f4a422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:43976/0 (socket says 172.21.15.18:43976) 2024-09-19T08:51:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 -- 172.21.15.18:0/34856333 learned_addr learned my addr 172.21.15.18:0/34856333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2cee59c640 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a31920 0x55c5f4a31d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 -- 172.21.15.18:0/34856333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 msgr2=0x55c5f4a34d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a34d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 -- 172.21.15.18:0/34856333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a31920 msgr2=0x55c5f4a31d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a31920 0x55c5f4a31d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.831+0000 7f2ceed9d640 1 -- 172.21.15.18:0/34856333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f493c340 con 0x55c5f4a35330 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.832+0000 7f2cee59c640 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a31920 0x55c5f4a31d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.832+0000 7f2cee59c640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2cd80a32f0 0x7f2cd80a57b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0101aa0 tx=0x7f2ce0011810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.832+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 0x55c5f4a422e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8011440 tx=0x7f2ce8011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0e77b4af740bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.832+0000 7f2cdcff9640 1 -- 172.21.15.18:0/34856333 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8004d20 con 0x55c5f4a35330 2024-09-19T08:51:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.832+0000 7f2cdcff9640 1 -- 172.21.15.18:0/34856333 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ce8004050 con 0x55c5f4a35330 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.832+0000 7f2cdcff9640 1 -- 172.21.15.18:0/34856333 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800f7a0 con 0x55c5f4a35330 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/34856333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 msgr2=0x55c5f4a422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 0x55c5f4a422e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8011440 tx=0x7f2ce8011900 comp rx=0 tx=0).stop 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/34856333 shutdown_connections 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a35330 0x55c5f4a422e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a34d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/34856333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a31920 0x55c5f4a31d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/34856333 >> 172.21.15.18:0/34856333 conn(0x55c5f4a2d010 msgr2=0x55c5f4a2d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/34856333 shutdown_connections 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.833+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/34856333 wait complete. 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 -- start start 2024-09-19T08:51:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 Processor -- start 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a32260 0x55c5f4a44a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a35330 0x55c5f4a4ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5f4a42b70 con 0x55c5f4a32260 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c5f491e290 con 0x55c5f4a31920 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c5f4a42cf0 con 0x55c5f4a35330 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cee59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cee59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:43978/0 (socket says 172.21.15.18:43978) 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cee59c640 1 -- 172.21.15.18:0/463409203 learned_addr learned my addr 172.21.15.18:0/463409203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a32260 0x55c5f4a44a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a35330 0x55c5f4a4ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.834+0000 7f2cf7ca7740 10 client.0 _ll_register_callbacks cb 0x55c5f494f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cee59c640 1 -- 172.21.15.18:0/463409203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a35330 msgr2=0x55c5f4a4ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cee59c640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a35330 0x55c5f4a4ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cee59c640 1 -- 172.21.15.18:0/463409203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a32260 msgr2=0x55c5f4a44a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cee59c640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a32260 0x55c5f4a44a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cee59c640 1 -- 172.21.15.18:0/463409203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5f46a8210 con 0x55c5f4a31920 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cee59c640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a444e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000fb90 tx=0x7f2ce0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e1877d038817b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/463409203 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0017040 con 0x55c5f4a31920 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce8004050 con 0x55c5f4a31920 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/463409203 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2ce001ebe0 con 0x55c5f4a31920 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/463409203 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2ce0031050 con 0x55c5f4a31920 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cf7ca7740 10 client.25241 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.835+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c5f4774620 con 0x55c5f4a31920 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/463409203 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ce8004050 con 0x55c5f4a31920 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/463409203 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2ce0025030 con 0x55c5f4a31920 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cf7ca7740 10 client.25241 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cf7ca7740 10 client.25241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cf7ca7740 20 client.25241 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4a50190 0x55c5f4a52600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cf7ca7740 4 client.25241 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5f49a2a20 con 0x55c5f4a50190 2024-09-19T08:51:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4a50190 0x55c5f4a52600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cd5ffb640 10 client.25241 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.836+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4a50190 0x55c5f4a52600 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e33fdb4d5db55f4 server_cookie=9ad8bb622a8bfc5a in_seq=0 out_seq=0 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.837+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/463409203 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5f49a2a20 con 0x55c5f4a50190 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.837+0000 7f2cd5ffb640 10 client.25241 handle_command_reply: tid=0 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.837+0000 7f2cf7ca7740 1 client.25241 shutdown 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.837+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 msgr2=0x55c5f4a444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.837+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a444e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000fb90 tx=0x7f2ce0004730 comp rx=0 tx=0).stop 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.837+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 shutdown_connections 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.838+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4a50190 0x55c5f4a52600 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.838+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a35330 0x55c5f4a4ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.838+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a32260 0x55c5f4a44a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.838+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/463409203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a444e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.838+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 >> 172.21.15.18:0/463409203 conn(0x55c5f4a2d010 msgr2=0x55c5f4a2e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.839+0000 7f2cd5ffb640 0 client.25241 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.839+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 shutdown_connections 2024-09-19T08:51:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.842+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/463409203 wait complete. 2024-09-19T08:51:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.843+0000 7f2cf7ca7740 20 client.25241 trim_cache size 0 max 16384 2024-09-19T08:51:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 Processor -- start 2024-09-19T08:51:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 -- start start 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a2d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a4ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a2dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01a64f0 con 0x55c5f4a35330 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01a8d70 con 0x55c5f4a31920 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2cf7ca7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01a6b60 con 0x55c5f4a32260 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a2dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a2dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41042/0 (socket says 172.21.15.18:41042) 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.868+0000 7f2ceed9d640 1 -- 172.21.15.18:0/2070736974 learned_addr learned my addr 172.21.15.18:0/2070736974 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2cee59c640 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a2d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a4ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2ceed9d640 1 -- 172.21.15.18:0/2070736974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 msgr2=0x55c5f4a4ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a4ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2ceed9d640 1 -- 172.21.15.18:0/2070736974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 msgr2=0x55c5f4a2d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a2d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2ceed9d640 1 -- 172.21.15.18:0/2070736974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f4a35070 con 0x55c5f4a35330 2024-09-19T08:51:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.869+0000 7f2ceed9d640 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a2dec0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x55c5f4a2de90 tx=0x7f2ce8003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a8df8d3b36187f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.870+0000 7f2cd7fff640 1 -- 172.21.15.18:0/2070736974 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce801d040 con 0x55c5f4a35330 2024-09-19T08:51:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.870+0000 7f2cd7fff640 1 -- 172.21.15.18:0/2070736974 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ce800f9f0 con 0x55c5f4a35330 2024-09-19T08:51:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.870+0000 7f2cd7fff640 1 -- 172.21.15.18:0/2070736974 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80055a0 con 0x55c5f4a35330 2024-09-19T08:51:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/2070736974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 msgr2=0x55c5f4a2dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a2dec0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x55c5f4a2de90 tx=0x7f2ce8003ae0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/2070736974 shutdown_connections 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a2dec0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a4ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/2070736974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a2d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/2070736974 >> 172.21.15.18:0/2070736974 conn(0x55c5f4a2d010 msgr2=0x55c5f4a3eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/2070736974 shutdown_connections 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.871+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/2070736974 wait complete. 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 -- start start 2024-09-19T08:51:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 Processor -- start 2024-09-19T08:51:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a48d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a49290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a4a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cee59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a48d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cedd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a49290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cee59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a48d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:44002/0 (socket says 172.21.15.18:44002) 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cedd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a49290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42368/0 (socket says 172.21.15.18:42368) 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a4a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a4a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41052/0 (socket says 172.21.15.18:41052) 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cee59c640 1 -- 172.21.15.18:0/329901117 learned_addr learned my addr 172.21.15.18:0/329901117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01a7230 con 0x55c5f4a35330 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01a86a0 con 0x55c5f4a31920 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.872+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01a7900 con 0x55c5f4a32260 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cf7ca7740 10 client.0 _ll_register_callbacks cb 0x7f2ce000f5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cee59c640 1 -- 172.21.15.18:0/329901117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 msgr2=0x55c5f4a49290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cee59c640 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a49290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cee59c640 1 -- 172.21.15.18:0/329901117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 msgr2=0x55c5f4a4a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cee59c640 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a4a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cee59c640 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5f4a4a8b0 con 0x55c5f4a31920 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cee59c640 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a48d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0004700 tx=0x7f2ce0026920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09c3dcca0ccd8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/329901117 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0039020 con 0x55c5f4a31920 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/329901117 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2ce0026d20 con 0x55c5f4a31920 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.873+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce800f9f0 con 0x55c5f4a31920 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.874+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/329901117 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2ce0044050 con 0x55c5f4a31920 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.874+0000 7f2cf7ca7740 10 client.25247 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.874+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c5f4a4bb80 con 0x55c5f4a31920 2024-09-19T08:51:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.874+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/329901117 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ce800f9f0 con 0x55c5f4a31920 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/329901117 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2ce0025040 con 0x55c5f4a31920 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cf7ca7740 10 client.25247 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cf7ca7740 10 client.25247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cf7ca7740 20 client.25247 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4acc430 0x55c5f4ace850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cf7ca7740 4 client.25247 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:51:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.875+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c5f499cd70 con 0x55c5f4acc430 2024-09-19T08:51:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.876+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4acc430 0x55c5f4ace850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.878+0000 7f2cd5ffb640 10 client.25247 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.878+0000 7f2cedd9b640 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4acc430 0x55c5f4ace850 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13fc8950814438ec server_cookie=d90a5c4b0a3c7dcc in_seq=0 out_seq=0 2024-09-19T08:51:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cd5ffb640 1 -- 172.21.15.18:0/329901117 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c5f499cd70 con 0x55c5f4acc430 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cd5ffb640 10 client.25247 handle_command_reply: tid=0 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 client.25247 shutdown 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 msgr2=0x55c5f4a48d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a48d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0004700 tx=0x7f2ce0026920 comp rx=0 tx=0).stop 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 shutdown_connections 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55c5f4acc430 0x55c5f4ace850 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5f4a35330 0x55c5f4a4a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f4a32260 0x55c5f4a49290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 --2- 172.21.15.18:0/329901117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c5f4a31920 0x55c5f4a48d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 >> 172.21.15.18:0/329901117 conn(0x55c5f4a2d010 msgr2=0x55c5f4a2b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cd5ffb640 0 client.25247 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 shutdown_connections 2024-09-19T08:51:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 1 -- 172.21.15.18:0/329901117 wait complete. 2024-09-19T08:51:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.892+0000 7f2cf7ca7740 20 client.25247 trim_cache size 0 max 16384 2024-09-19T08:51:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:51:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:51:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:51:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2cd80a32f0 msgr2=0x7f2cd80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2cd80a32f0 0x7f2cd80a57b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0101aa0 tx=0x7f2ce0011810 comp rx=0 tx=0).stop 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 msgr2=0x7f2cf019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf019ca50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40314e0 tx=0x7f2ce4003c10 comp rx=0 tx=0).stop 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 shutdown_connections 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2cd80a32f0 0x7f2cd80a57b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf0102600 0x7f2cf019f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf0101c40 0x7f2cf019ca50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 --2- 172.21.15.18:0/1303498862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf0100a50 0x7f2cf006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 >> 172.21.15.18:0/1303498862 conn(0x7f2cf00fc1b0 msgr2=0x7f2cf0104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 shutdown_connections 2024-09-19T08:51:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:01.893+0000 7f2cf4f11640 1 -- 172.21.15.18:0/1303498862 wait complete. 2024-09-19T08:51:02.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:01 smithi150 ceph-mon[34610]: pgmap v521: 129 pgs: 129 active+clean; 69 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 688 op/s 2024-09-19T08:51:02.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:01 smithi162 ceph-mon[34870]: pgmap v521: 129 pgs: 129 active+clean; 69 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 688 op/s 2024-09-19T08:51:02.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:01 smithi018 ceph-mon[30956]: pgmap v521: 129 pgs: 129 active+clean; 69 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 688 op/s 2024-09-19T08:51:04.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:03 smithi150 ceph-mon[34610]: pgmap v522: 129 pgs: 129 active+clean; 71 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.9 MiB/s wr, 669 op/s 2024-09-19T08:51:04.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:03 smithi162 ceph-mon[34870]: pgmap v522: 129 pgs: 129 active+clean; 71 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.9 MiB/s wr, 669 op/s 2024-09-19T08:51:04.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:03 smithi018 ceph-mon[30956]: pgmap v522: 129 pgs: 129 active+clean; 71 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.9 MiB/s wr, 669 op/s 2024-09-19T08:51:06.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:05 smithi150 ceph-mon[34610]: pgmap v523: 129 pgs: 129 active+clean; 60 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.4 MiB/s wr, 572 op/s 2024-09-19T08:51:06.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:05 smithi162 ceph-mon[34870]: pgmap v523: 129 pgs: 129 active+clean; 60 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.4 MiB/s wr, 572 op/s 2024-09-19T08:51:06.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:05 smithi018 ceph-mon[30956]: pgmap v523: 129 pgs: 129 active+clean; 60 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.4 MiB/s wr, 572 op/s 2024-09-19T08:51:08.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:07 smithi150 ceph-mon[34610]: pgmap v524: 129 pgs: 129 active+clean; 77 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.0 MiB/s wr, 700 op/s 2024-09-19T08:51:08.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:07 smithi162 ceph-mon[34870]: pgmap v524: 129 pgs: 129 active+clean; 77 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.0 MiB/s wr, 700 op/s 2024-09-19T08:51:08.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:07 smithi018 ceph-mon[30956]: pgmap v524: 129 pgs: 129 active+clean; 77 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.0 MiB/s wr, 700 op/s 2024-09-19T08:51:10.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:09 smithi150 ceph-mon[34610]: pgmap v525: 129 pgs: 129 active+clean; 68 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 613 op/s 2024-09-19T08:51:10.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:09 smithi162 ceph-mon[34870]: pgmap v525: 129 pgs: 129 active+clean; 68 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 613 op/s 2024-09-19T08:51:10.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:09 smithi018 ceph-mon[30956]: pgmap v525: 129 pgs: 129 active+clean; 68 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 613 op/s 2024-09-19T08:51:12.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:11 smithi150 ceph-mon[34610]: pgmap v526: 129 pgs: 129 active+clean; 64 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.9 MiB/s wr, 687 op/s 2024-09-19T08:51:12.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:11 smithi162 ceph-mon[34870]: pgmap v526: 129 pgs: 129 active+clean; 64 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.9 MiB/s wr, 687 op/s 2024-09-19T08:51:12.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:11 smithi018 ceph-mon[30956]: pgmap v526: 129 pgs: 129 active+clean; 64 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.9 MiB/s wr, 687 op/s 2024-09-19T08:51:14.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:13 smithi150 ceph-mon[34610]: pgmap v527: 129 pgs: 129 active+clean; 61 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.8 MiB/s wr, 664 op/s 2024-09-19T08:51:14.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:13 smithi162 ceph-mon[34870]: pgmap v527: 129 pgs: 129 active+clean; 61 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.8 MiB/s wr, 664 op/s 2024-09-19T08:51:14.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:13 smithi018 ceph-mon[30956]: pgmap v527: 129 pgs: 129 active+clean; 61 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.8 MiB/s wr, 664 op/s 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 -- 172.21.15.18:0/3634472782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558102600 msgr2=0x7f5558108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 --2- 172.21.15.18:0/3634472782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558102600 0x7f5558108e90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5550009ca0 tx=0x7f555002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 -- 172.21.15.18:0/3634472782 shutdown_connections 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 --2- 172.21.15.18:0/3634472782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558102600 0x7f5558108e90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 --2- 172.21.15.18:0/3634472782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5558101c40 0x7f55581020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 --2- 172.21.15.18:0/3634472782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 0x7f5558100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.012+0000 7f555fb31640 1 -- 172.21.15.18:0/3634472782 >> 172.21.15.18:0/3634472782 conn(0x7f55580fc1b0 msgr2=0x7f55580fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.013+0000 7f555fb31640 1 -- 172.21.15.18:0/3634472782 shutdown_connections 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.014+0000 7f555fb31640 1 -- 172.21.15.18:0/3634472782 wait complete. 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 Processor -- start 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 -- start start 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 0x7f555806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558101c40 0x7f555819c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5558102600 0x7f555819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f555810c580 con 0x7f5558101c40 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f555810c400 con 0x7f5558102600 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555fb31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f555810c700 con 0x7f5558100a50 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555d0cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558101c40 0x7f555819c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555d0cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558101c40 0x7f555819c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41472/0 (socket says 172.21.15.18:41472) 2024-09-19T08:51:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555d0cc640 1 -- 172.21.15.18:0/1407507037 learned_addr learned my addr 172.21.15.18:0/1407507037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.015+0000 7f555d8cd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 0x7f555806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555e0ce640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5558102600 0x7f555819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555d8cd640 1 -- 172.21.15.18:0/1407507037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5558102600 msgr2=0x7f555819ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555d8cd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5558102600 0x7f555819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555d8cd640 1 -- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558101c40 msgr2=0x7f555819c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555d8cd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558101c40 0x7f555819c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555d8cd640 1 -- 172.21.15.18:0/1407507037 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555819f700 con 0x7f5558100a50 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555d8cd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 0x7f555806aeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f555400e9c0 tx=0x7f555400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f554effd640 1 -- 172.21.15.18:0/1407507037 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555400ccc0 con 0x7f5558100a50 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f554effd640 1 -- 172.21.15.18:0/1407507037 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55540035f0 con 0x7f5558100a50 2024-09-19T08:51:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555819f9f0 con 0x7f5558100a50 2024-09-19T08:51:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f554effd640 1 -- 172.21.15.18:0/1407507037 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555400ce60 con 0x7f5558100a50 2024-09-19T08:51:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.016+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555819ff40 con 0x7f5558100a50 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.019+0000 7f55628ce740 1 Processor -- start 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.019+0000 7f55628ce740 1 -- start start 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.019+0000 7f55628ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.019+0000 7f55628ce740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf182e0 0x56503bf1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.019+0000 7f55628ce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf1f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f55628ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56503be7b2f0 con 0x56503bf179a0 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f55628ce740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56503be23270 con 0x56503bf182e0 2024-09-19T08:51:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f55628ce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56503be772b0 con 0x56503bf1d370 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41478/0 (socket says 172.21.15.18:41478) 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555d0cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf1f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 -- 172.21.15.18:0/331881088 learned_addr learned my addr 172.21.15.18:0/331881088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 -- 172.21.15.18:0/331881088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 msgr2=0x56503bf1f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf1f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 -- 172.21.15.18:0/331881088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf182e0 msgr2=0x56503bf1cda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf182e0 0x56503bf1cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 -- 172.21.15.18:0/331881088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56503be22340 con 0x56503bf179a0 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f554effd640 1 -- 172.21.15.18:0/1407507037 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f55540037a0 con 0x7f5558100a50 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.020+0000 7f555e0ce640 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5550009dc0 tx=0x7f5550005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44d9e2bf6639691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.021+0000 7f5543fff640 1 -- 172.21.15.18:0/331881088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550031ab0 con 0x56503bf179a0 2024-09-19T08:51:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.021+0000 7f5543fff640 1 -- 172.21.15.18:0/331881088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5550036070 con 0x56503bf179a0 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.021+0000 7f5543fff640 1 -- 172.21.15.18:0/331881088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550004040 con 0x56503bf179a0 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.021+0000 7f554effd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55440a3370 0x7f55440a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.021+0000 7f555d8cd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55440a3370 0x7f55440a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.021+0000 7f554effd640 1 -- 172.21.15.18:0/1407507037 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f55540d00e0 con 0x7f5558100a50 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 -- 172.21.15.18:0/331881088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 msgr2=0x56503bf17da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5550009dc0 tx=0x7f5550005ef0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 -- 172.21.15.18:0/331881088 shutdown_connections 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf1f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf182e0 0x56503bf1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 --2- 172.21.15.18:0/331881088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17da0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 -- 172.21.15.18:0/331881088 >> 172.21.15.18:0/331881088 conn(0x56503bf13010 msgr2=0x56503bf13410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 -- 172.21.15.18:0/331881088 shutdown_connections 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f555d8cd640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55440a3370 0x7f55440a5830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f555400c6a0 tx=0x7f55540917b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 -- 172.21.15.18:0/331881088 wait complete. 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 -- start start 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.022+0000 7f55628ce740 1 Processor -- start 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 0x56503bf21b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf182e0 0x56503bf220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf290e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56503bf202e0 con 0x56503bf182e0 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56503be04290 con 0x56503bf179a0 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56503bf20460 con 0x56503bf1d370 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f55628ce740 10 client.0 _ll_register_callbacks cb 0x56503be35140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 0x56503bf21b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555d0cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf182e0 0x56503bf220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 0x56503bf21b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:59224/0 (socket says 172.21.15.18:59224) 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555e0ce640 1 -- 172.21.15.18:0/4021431472 learned_addr learned my addr 172.21.15.18:0/4021431472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555d0cc640 1 -- 172.21.15.18:0/4021431472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 msgr2=0x56503bf290e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf290e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555d0cc640 1 -- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 msgr2=0x56503bf21b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 0x56503bf21b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555d0cc640 1 -- 172.21.15.18:0/4021431472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56503bb8e210 con 0x56503bf182e0 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.023+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 0x56503bf21b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf182e0 0x56503bf220a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5548009620 tx=0x7f5548012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac5a02ffe1b9a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55417fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:51:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55417fa640 1 -- 172.21.15.18:0/4021431472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548004050 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55417fa640 1 -- 172.21.15.18:0/4021431472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f55480041f0 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5550036070 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55417fa640 1 -- 172.21.15.18:0/4021431472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5548025050 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55628ce740 10 client.15627 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56503bc5a620 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55417fa640 1 -- 172.21.15.18:0/4021431472 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5550036070 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55417fa640 1 -- 172.21.15.18:0/4021431472 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5548003a70 con 0x56503bf182e0 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55628ce740 10 client.15627 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55628ce740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.024+0000 7f55628ce740 20 client.15627 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.025+0000 7f55628ce740 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf34060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.025+0000 7f55628ce740 4 client.15627 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.025+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56503be88a20 con 0x56503bf31c70 2024-09-19T08:51:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.025+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf34060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.025+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf34060 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688163006b119316 server_cookie=d0fd36ec7c504cb9 in_seq=0 out_seq=0 2024-09-19T08:51:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.025+0000 7f55417fa640 10 client.15627 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55417fa640 1 -- 172.21.15.18:0/4021431472 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56503be88a20 con 0x56503bf31c70 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55417fa640 10 client.15627 handle_command_reply: tid=0 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 client.15627 shutdown 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf182e0 msgr2=0x56503bf220a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf182e0 0x56503bf220a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5548009620 tx=0x7f5548012bf0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 shutdown_connections 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf34060 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55417fa640 0 client.15627 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf1d370 0x56503bf290e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf182e0 0x56503bf220a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 --2- 172.21.15.18:0/4021431472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf179a0 0x56503bf21b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 >> 172.21.15.18:0/4021431472 conn(0x56503bf13010 msgr2=0x56503bf14820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 shutdown_connections 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.026+0000 7f55628ce740 1 -- 172.21.15.18:0/4021431472 wait complete. 2024-09-19T08:51:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.027+0000 7f55628ce740 20 client.15627 trim_cache size 0 max 16384 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.051+0000 7f55628ce740 1 Processor -- start 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.051+0000 7f55628ce740 1 -- start start 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.051+0000 7f55628ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.051+0000 7f55628ce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.051+0000 7f55628ce740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf13e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.051+0000 7f55628ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55581a6420 con 0x56503bf179a0 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f55628ce740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55581a8ca0 con 0x56503bf1d370 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f55628ce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55581a6a90 con 0x56503bf182e0 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555d0cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41490/0 (socket says 172.21.15.18:41490) 2024-09-19T08:51:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555d0cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf290a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53906/0 (socket says 172.21.15.18:53906) 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 -- 172.21.15.18:0/3858103596 learned_addr learned my addr 172.21.15.18:0/3858103596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf13e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 -- 172.21.15.18:0/3858103596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 msgr2=0x56503bf290a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf290a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 -- 172.21.15.18:0/3858103596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 msgr2=0x56503bf13e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf13e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 -- 172.21.15.18:0/3858103596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56503bf187c0 con 0x56503bf179a0 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555d0cc640 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.052+0000 7f555e0ce640 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5550003fd0 tx=0x7f5550031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791feb8458cc722 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.053+0000 7f55437fe640 1 -- 172.21.15.18:0/3858103596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550059070 con 0x56503bf179a0 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.053+0000 7f55437fe640 1 -- 172.21.15.18:0/3858103596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5550036050 con 0x56503bf179a0 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.053+0000 7f55437fe640 1 -- 172.21.15.18:0/3858103596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550049040 con 0x56503bf179a0 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 -- 172.21.15.18:0/3858103596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 msgr2=0x56503bf17d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5550003fd0 tx=0x7f5550031000 comp rx=0 tx=0).stop 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 -- 172.21.15.18:0/3858103596 shutdown_connections 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf13e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 --2- 172.21.15.18:0/3858103596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf17d80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 -- 172.21.15.18:0/3858103596 >> 172.21.15.18:0/3858103596 conn(0x56503bf13010 msgr2=0x56503bf1cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 -- 172.21.15.18:0/3858103596 shutdown_connections 2024-09-19T08:51:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 -- 172.21.15.18:0/3858103596 wait complete. 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.054+0000 7f55628ce740 1 -- start start 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 Processor -- start 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf26590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf26ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf27ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55581a7160 con 0x56503bf179a0 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55581a85d0 con 0x56503bf1d370 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.055+0000 7f55628ce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55581a7830 con 0x56503bf182e0 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f55628ce740 10 client.0 _ll_register_callbacks cb 0x7f55480099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf26590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf26590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41494/0 (socket says 172.21.15.18:41494) 2024-09-19T08:51:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 -- 172.21.15.18:0/4064271921 learned_addr learned my addr 172.21.15.18:0/4064271921 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf26ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf27ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 -- 172.21.15.18:0/4064271921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 msgr2=0x56503bf26ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf26ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 -- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 msgr2=0x56503bf27ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf27ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 -- 172.21.15.18:0/4064271921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56503bf280f0 con 0x56503bf179a0 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf26ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f555e0ce640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf26590 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5550004360 tx=0x7f5550003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc9c534283df15e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.056+0000 7f55417fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55417fa640 1 -- 172.21.15.18:0/4064271921 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550063060 con 0x56503bf179a0 2024-09-19T08:51:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55417fa640 1 -- 172.21.15.18:0/4064271921 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5550031ab0 con 0x56503bf179a0 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5550036050 con 0x56503bf179a0 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55417fa640 1 -- 172.21.15.18:0/4064271921 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5550059070 con 0x56503bf179a0 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 10 client.15633 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56503bf29400 con 0x56503bf179a0 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55417fa640 1 -- 172.21.15.18:0/4064271921 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5550036050 con 0x56503bf179a0 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55417fa640 1 -- 172.21.15.18:0/4064271921 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f555004f040 con 0x56503bf179a0 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 10 client.15633 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 20 client.15633 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf9ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 4 client.15633 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56503be82d70 con 0x56503bf31c70 2024-09-19T08:51:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.057+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf9ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.058+0000 7f55417fa640 10 client.15633 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.058+0000 7f555d0cc640 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf9ec70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b77fb37663c24d2b server_cookie=7c6dbadd9e59660d in_seq=0 out_seq=0 2024-09-19T08:51:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55417fa640 1 -- 172.21.15.18:0/4064271921 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56503be82d70 con 0x56503bf31c70 2024-09-19T08:51:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55417fa640 10 client.15633 handle_command_reply: tid=0 2024-09-19T08:51:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 client.15633 shutdown 2024-09-19T08:51:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 msgr2=0x56503bf26590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf26590 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5550004360 tx=0x7f5550003970 comp rx=0 tx=0).stop 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 shutdown_connections 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56503bf31c70 0x56503bf9ec70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56503bf1d370 0x56503bf27ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55417fa640 0 client.15633 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56503bf182e0 0x56503bf26ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 --2- 172.21.15.18:0/4064271921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56503bf179a0 0x56503bf26590 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 >> 172.21.15.18:0/4064271921 conn(0x56503bf13010 msgr2=0x56503bf119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.071+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 shutdown_connections 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.072+0000 7f55628ce740 1 -- 172.21.15.18:0/4064271921 wait complete. 2024-09-19T08:51:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.072+0000 7f55628ce740 20 client.15633 trim_cache size 0 max 16384 2024-09-19T08:51:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:51:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:51:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:51:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:51:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55440a3370 msgr2=0x7f55440a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55440a3370 0x7f55440a5830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f555400c6a0 tx=0x7f55540917b0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 msgr2=0x7f555806aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 0x7f555806aeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f555400e9c0 tx=0x7f555400ee80 comp rx=0 tx=0).stop 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 shutdown_connections 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f55440a3370 0x7f55440a5830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5558102600 0x7f555819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5558101c40 0x7f555819c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 --2- 172.21.15.18:0/1407507037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5558100a50 0x7f555806aeb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 >> 172.21.15.18:0/1407507037 conn(0x7f55580fc1b0 msgr2=0x7f55580fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 shutdown_connections 2024-09-19T08:51:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:15.073+0000 7f555fb31640 1 -- 172.21.15.18:0/1407507037 wait complete. 2024-09-19T08:51:16.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:15 smithi150 ceph-mon[34610]: pgmap v528: 129 pgs: 129 active+clean; 57 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 572 op/s 2024-09-19T08:51:16.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:15 smithi162 ceph-mon[34870]: pgmap v528: 129 pgs: 129 active+clean; 57 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 572 op/s 2024-09-19T08:51:16.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:15 smithi018 ceph-mon[30956]: pgmap v528: 129 pgs: 129 active+clean; 57 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 572 op/s 2024-09-19T08:51:17.060 INFO:tasks.workunit.client.0.smithi018.stdout:20000 trunc from 0x62a09d3 to 0x111d204 2024-09-19T08:51:18.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:17 smithi150 ceph-mon[34610]: pgmap v529: 129 pgs: 129 active+clean; 71 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 692 op/s 2024-09-19T08:51:18.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:17 smithi162 ceph-mon[34870]: pgmap v529: 129 pgs: 129 active+clean; 71 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 692 op/s 2024-09-19T08:51:18.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:17 smithi018 ceph-mon[30956]: pgmap v529: 129 pgs: 129 active+clean; 71 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 692 op/s 2024-09-19T08:51:20.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:19 smithi150 ceph-mon[34610]: pgmap v530: 129 pgs: 129 active+clean; 77 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.7 MiB/s wr, 594 op/s 2024-09-19T08:51:20.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:19 smithi162 ceph-mon[34870]: pgmap v530: 129 pgs: 129 active+clean; 77 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.7 MiB/s wr, 594 op/s 2024-09-19T08:51:20.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:19 smithi018 ceph-mon[30956]: pgmap v530: 129 pgs: 129 active+clean; 77 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.7 MiB/s wr, 594 op/s 2024-09-19T08:51:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:21.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:20 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:51:21.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:21.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:21.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:21.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:20 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:51:21.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:21.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:21.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:21.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:51:22.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:21 smithi150 ceph-mon[34610]: pgmap v531: 129 pgs: 129 active+clean; 71 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2024-09-19T08:51:22.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:21 smithi162 ceph-mon[34870]: pgmap v531: 129 pgs: 129 active+clean; 71 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2024-09-19T08:51:22.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:21 smithi018 ceph-mon[30956]: pgmap v531: 129 pgs: 129 active+clean; 71 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2024-09-19T08:51:24.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:23 smithi150 ceph-mon[34610]: pgmap v532: 129 pgs: 129 active+clean; 76 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 637 op/s 2024-09-19T08:51:24.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:23 smithi162 ceph-mon[34870]: pgmap v532: 129 pgs: 129 active+clean; 76 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 637 op/s 2024-09-19T08:51:24.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:23 smithi018 ceph-mon[30956]: pgmap v532: 129 pgs: 129 active+clean; 76 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 637 op/s 2024-09-19T08:51:26.068 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:25 smithi150 ceph-mon[34610]: pgmap v533: 129 pgs: 129 active+clean; 70 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-19T08:51:26.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:25 smithi162 ceph-mon[34870]: pgmap v533: 129 pgs: 129 active+clean; 70 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-19T08:51:26.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:25 smithi018 ceph-mon[30956]: pgmap v533: 129 pgs: 129 active+clean; 70 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.7 MiB/s wr, 548 op/s 2024-09-19T08:51:28.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:27 smithi150 ceph-mon[34610]: pgmap v534: 129 pgs: 129 active+clean; 58 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.2 MiB/s wr, 656 op/s 2024-09-19T08:51:28.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:27 smithi162 ceph-mon[34870]: pgmap v534: 129 pgs: 129 active+clean; 58 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.2 MiB/s wr, 656 op/s 2024-09-19T08:51:28.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:27 smithi018 ceph-mon[30956]: pgmap v534: 129 pgs: 129 active+clean; 58 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.2 MiB/s wr, 656 op/s 2024-09-19T08:51:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.197+0000 7f136285a640 1 -- 172.21.15.18:0/1273227061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c0736c0 msgr2=0x7f135c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.197+0000 7f136285a640 1 --2- 172.21.15.18:0/1273227061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c0736c0 0x7f135c10a6d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1354009ca0 tx=0x7f135402a8d0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 -- 172.21.15.18:0/1273227061 shutdown_connections 2024-09-19T08:51:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 --2- 172.21.15.18:0/1273227061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c0736c0 0x7f135c10a6d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 --2- 172.21.15.18:0/1273227061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c072d20 0x7f135c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 --2- 172.21.15.18:0/1273227061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c109700 0x7f135c109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 -- 172.21.15.18:0/1273227061 >> 172.21.15.18:0/1273227061 conn(0x7f135c06ece0 msgr2=0x7f135c071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 -- 172.21.15.18:0/1273227061 shutdown_connections 2024-09-19T08:51:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.198+0000 7f136285a640 1 -- 172.21.15.18:0/1273227061 wait complete. 2024-09-19T08:51:28.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 Processor -- start 2024-09-19T08:51:28.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 -- start start 2024-09-19T08:51:28.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 0x7f135c1a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c0736c0 0x7f135c1a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c109700 0x7f135c1a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f135c118090 con 0x7f135c0736c0 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f135c117f10 con 0x7f135c109700 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f136285a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f135c118210 con 0x7f135c072d20 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c0736c0 0x7f135c1a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f135bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 0x7f135c1a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f135bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 0x7f135c1a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49964/0 (socket says 172.21.15.18:49964) 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c0736c0 0x7f135c1a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58690/0 (socket says 172.21.15.18:58690) 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f135bfff640 1 -- 172.21.15.18:0/2979685661 learned_addr learned my addr 172.21.15.18:0/2979685661 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.199+0000 7f1360df7640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c109700 0x7f135c1a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f135bfff640 1 -- 172.21.15.18:0/2979685661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c109700 msgr2=0x7f135c1a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f135bfff640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c109700 0x7f135c1a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f135bfff640 1 -- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c0736c0 msgr2=0x7f135c1a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f135bfff640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c0736c0 0x7f135c1a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f135bfff640 1 -- 172.21.15.18:0/2979685661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c1aa290 con 0x7f135c072d20 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f135bfff640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 0x7f135c1a2670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f134c00e9f0 tx=0x7f134c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f13597fa640 1 -- 172.21.15.18:0/2979685661 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c00cd80 con 0x7f135c072d20 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f13597fa640 1 -- 172.21.15.18:0/2979685661 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f134c0108e0 con 0x7f135c072d20 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c1aa580 con 0x7f135c072d20 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f13597fa640 1 -- 172.21.15.18:0/2979685661 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c018920 con 0x7f135c072d20 2024-09-19T08:51:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.200+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c1aaad0 con 0x7f135c072d20 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 Processor -- start 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13597fa640 1 -- 172.21.15.18:0/2979685661 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f134c018ac0 con 0x7f135c072d20 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 -- start start 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdde370 0x5620bfde0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5620bfd3c2f0 con 0x5620bfdd89a0 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5620bfce4270 con 0x5620bfdd92e0 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f13655f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5620bfd382b0 con 0x5620bfdde370 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f135bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f1360df7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f1360df7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58706/0 (socket says 172.21.15.18:58706) 2024-09-19T08:51:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f135bfff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdddda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:60464/0 (socket says 172.21.15.18:60464) 2024-09-19T08:51:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f1360df7640 1 -- 172.21.15.18:0/647668910 learned_addr learned my addr 172.21.15.18:0/647668910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.204+0000 7f135b7fe640 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdde370 0x5620bfde0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f1360df7640 1 -- 172.21.15.18:0/647668910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdde370 msgr2=0x5620bfde0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f1360df7640 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdde370 0x5620bfde0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f1360df7640 1 -- 172.21.15.18:0/647668910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 msgr2=0x5620bfdddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f1360df7640 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f1360df7640 1 -- 172.21.15.18:0/647668910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620bfce3340 con 0x5620bfdd89a0 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f135bfff640 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f13597fa640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f13440a3370 0x7f13440a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f1360df7640 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8da0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1354035000 tx=0x7f13540093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892a90506e2b4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.205+0000 7f13597fa640 1 -- 172.21.15.18:0/2979685661 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f134c0d0040 con 0x7f135c072d20 2024-09-19T08:51:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.206+0000 7f13427fc640 1 -- 172.21.15.18:0/647668910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354031460 con 0x5620bfdd89a0 2024-09-19T08:51:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.206+0000 7f135bfff640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f13440a3370 0x7f13440a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.206+0000 7f13427fc640 1 -- 172.21.15.18:0/647668910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1354036040 con 0x5620bfdd89a0 2024-09-19T08:51:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.206+0000 7f13427fc640 1 -- 172.21.15.18:0/647668910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354004280 con 0x5620bfdd89a0 2024-09-19T08:51:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 -- 172.21.15.18:0/647668910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 msgr2=0x5620bfdd8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8da0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1354035000 tx=0x7f13540093f0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f135bfff640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f13440a3370 0x7f13440a5830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f134c09bfe0 tx=0x7f134c0d3a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 -- 172.21.15.18:0/647668910 shutdown_connections 2024-09-19T08:51:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdde370 0x5620bfde0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 --2- 172.21.15.18:0/647668910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8da0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 -- 172.21.15.18:0/647668910 >> 172.21.15.18:0/647668910 conn(0x5620bfdd4010 msgr2=0x5620bfdd4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 -- 172.21.15.18:0/647668910 shutdown_connections 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.207+0000 7f13655f5740 1 -- 172.21.15.18:0/647668910 wait complete. 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 -- start start 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 Processor -- start 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfde2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfde3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdea080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5620bfde1320 con 0x5620bfdde370 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5620bfcc5290 con 0x5620bfdd92e0 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5620bfde14a0 con 0x5620bfdd89a0 2024-09-19T08:51:28.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.208+0000 7f13655f5740 10 client.0 _ll_register_callbacks cb 0x5620bfcf6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfde3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f1360df7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfde3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:60470/0 (socket says 172.21.15.18:60470) 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f1360df7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfde2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 -- 172.21.15.18:0/320919989 learned_addr learned my addr 172.21.15.18:0/320919989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 -- 172.21.15.18:0/320919989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 msgr2=0x5620bfde2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfde2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 -- 172.21.15.18:0/320919989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 msgr2=0x5620bfdea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 -- 172.21.15.18:0/320919989 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620bfa4f210 con 0x5620bfdd92e0 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f1360df7640 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfde2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f135b7fe640 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfde3040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f135000bad0 tx=0x7f135000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f80f8af1a8c2063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.209+0000 7f133b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f133b7fe640 1 -- 172.21.15.18:0/320919989 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350003e20 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f133b7fe640 1 -- 172.21.15.18:0/320919989 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1350011440 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1354036040 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f133b7fe640 1 -- 172.21.15.18:0/320919989 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1350011640 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 10 client.25271 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5620bfb1b620 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f133b7fe640 1 -- 172.21.15.18:0/320919989 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1354036040 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f133b7fe640 1 -- 172.21.15.18:0/320919989 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f135001ba30 con 0x5620bfdd92e0 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 10 client.25271 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 10 client.25271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 20 client.25271 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.210+0000 7f13655f5740 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfdf70a0 0x5620bfdf9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.211+0000 7f13655f5740 4 client.25271 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:28.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.211+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620bfd49a20 con 0x5620bfdf70a0 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.211+0000 7f1360df7640 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfdf70a0 0x5620bfdf9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.211+0000 7f1360df7640 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfdf70a0 0x5620bfdf9490 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=353601c604858f1d server_cookie=5712975a2ed46f93 in_seq=0 out_seq=0 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.211+0000 7f133b7fe640 10 client.25271 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f133b7fe640 1 -- 172.21.15.18:0/320919989 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620bfd49a20 con 0x5620bfdf70a0 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f133b7fe640 10 client.25271 handle_command_reply: tid=0 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 client.25271 shutdown 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 msgr2=0x5620bfde3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfde3040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f135000bad0 tx=0x7f135000bf90 comp rx=0 tx=0).stop 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 shutdown_connections 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfdf70a0 0x5620bfdf9490 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfde3040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f133b7fe640 0 client.25271 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 --2- 172.21.15.18:0/320919989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfde2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.212+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 >> 172.21.15.18:0/320919989 conn(0x5620bfdd4010 msgr2=0x5620bfdd5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.213+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 shutdown_connections 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.213+0000 7f13655f5740 1 -- 172.21.15.18:0/320919989 wait complete. 2024-09-19T08:51:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.213+0000 7f13655f5740 20 client.25271 trim_cache size 0 max 16384 2024-09-19T08:51:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.236+0000 7f13655f5740 1 Processor -- start 2024-09-19T08:51:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.237+0000 7f13655f5740 1 -- start start 2024-09-19T08:51:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.237+0000 7f13655f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f13655f5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f13655f5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdd30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f1360df7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f1360df7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49994/0 (socket says 172.21.15.18:49994) 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:60480/0 (socket says 172.21.15.18:60480) 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f1360df7640 1 -- 172.21.15.18:0/1904224474 learned_addr learned my addr 172.21.15.18:0/1904224474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1aec00 con 0x5620bfdde370 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1b1480 con 0x5620bfdd92e0 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.238+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1af270 con 0x5620bfdd89a0 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f1360df7640 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdd30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f135b7fe640 1 -- 172.21.15.18:0/1904224474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 msgr2=0x5620bfdd8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f135b7fe640 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f135b7fe640 1 -- 172.21.15.18:0/1904224474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 msgr2=0x5620bfdd30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f135b7fe640 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdd30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f135b7fe640 1 -- 172.21.15.18:0/1904224474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620bfdf5950 con 0x5620bfdd92e0 2024-09-19T08:51:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f1360df7640 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdd30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:28.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f135b7fe640 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdea040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f135001bf20 tx=0x7f13500115d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba97ae478e447d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:28.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.239+0000 7f1341ffb640 1 -- 172.21.15.18:0/1904224474 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135002e070 con 0x5620bfdd92e0 2024-09-19T08:51:28.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.240+0000 7f1341ffb640 1 -- 172.21.15.18:0/1904224474 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1350003e20 con 0x5620bfdd92e0 2024-09-19T08:51:28.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.240+0000 7f1341ffb640 1 -- 172.21.15.18:0/1904224474 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350011c60 con 0x5620bfdd92e0 2024-09-19T08:51:28.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.241+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 msgr2=0x5620bfdea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.241+0000 7f13655f5740 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdea040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f135001bf20 tx=0x7f13500115d0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.243+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 shutdown_connections 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.243+0000 7f13655f5740 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfdd30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.243+0000 7f13655f5740 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd92e0 0x5620bfdea040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.243+0000 7f13655f5740 1 --2- 172.21.15.18:0/1904224474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd89a0 0x5620bfdd8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.243+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 >> 172.21.15.18:0/1904224474 conn(0x5620bfdd4010 msgr2=0x5620bfdd29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.243+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 shutdown_connections 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.244+0000 7f13655f5740 1 -- 172.21.15.18:0/1904224474 wait complete. 2024-09-19T08:51:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.244+0000 7f13655f5740 1 -- start start 2024-09-19T08:51:28.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 Processor -- start 2024-09-19T08:51:28.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd89a0 0x5620bfde7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd92e0 0x5620bfde7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfde8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1af940 con 0x5620bfdde370 2024-09-19T08:51:28.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1b0db0 con 0x5620bfdd89a0 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1b0010 con 0x5620bfdd92e0 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f13655f5740 10 client.0 _ll_register_callbacks cb 0x7f1350004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f1360df7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd89a0 0x5620bfde7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd92e0 0x5620bfde7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f1360df7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd89a0 0x5620bfde7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:60482/0 (socket says 172.21.15.18:60482) 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f1360df7640 1 -- 172.21.15.18:0/1497283655 learned_addr learned my addr 172.21.15.18:0/1497283655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.245+0000 7f1360df7640 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfde8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f135b7fe640 1 -- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd89a0 msgr2=0x5620bfde7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f135b7fe640 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd89a0 0x5620bfde7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f135b7fe640 1 -- 172.21.15.18:0/1497283655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 msgr2=0x5620bfde8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f135b7fe640 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfde8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f135b7fe640 1 -- 172.21.15.18:0/1497283655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620bfde93d0 con 0x5620bfdd92e0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f135b7fe640 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd92e0 0x5620bfde7db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5620bfcc52b0 tx=0x7f135000b5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa9d7c410856237 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.246+0000 7f133b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f133b7fe640 1 -- 172.21.15.18:0/1497283655 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350036020 con 0x5620bfdd92e0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f133b7fe640 1 -- 172.21.15.18:0/1497283655 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f13500105c0 con 0x5620bfdd92e0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1350003e20 con 0x5620bfdd92e0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f133b7fe640 1 -- 172.21.15.18:0/1497283655 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1350011e60 con 0x5620bfdd92e0 2024-09-19T08:51:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 10 client.25369 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5620bfded0a0 con 0x5620bfdd92e0 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f133b7fe640 1 -- 172.21.15.18:0/1497283655 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1350003e20 con 0x5620bfdd92e0 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f133b7fe640 1 -- 172.21.15.18:0/1497283655 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1350031070 con 0x5620bfdd92e0 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 10 client.25369 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 10 client.25369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 20 client.25369 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfded940 0x5620bfdefd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 4 client.25369 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.247+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620bfde0cb0 con 0x5620bfded940 2024-09-19T08:51:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.248+0000 7f1360df7640 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfded940 0x5620bfdefd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.248+0000 7f133b7fe640 10 client.25369 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.248+0000 7f1360df7640 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfded940 0x5620bfdefd60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8afdbfb1867397ec server_cookie=315ed715cd7b244d in_seq=0 out_seq=0 2024-09-19T08:51:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f133b7fe640 1 -- 172.21.15.18:0/1497283655 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620bfde0cb0 con 0x5620bfded940 2024-09-19T08:51:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f133b7fe640 10 client.25369 handle_command_reply: tid=0 2024-09-19T08:51:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 client.25369 shutdown 2024-09-19T08:51:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd92e0 msgr2=0x5620bfde7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd92e0 0x5620bfde7db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5620bfcc52b0 tx=0x7f135000b5c0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 shutdown_connections 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5620bfded940 0x5620bfdefd60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620bfdde370 0x5620bfde8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620bfdd92e0 0x5620bfde7db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 --2- 172.21.15.18:0/1497283655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5620bfdd89a0 0x5620bfde7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 >> 172.21.15.18:0/1497283655 conn(0x5620bfdd4010 msgr2=0x5620bfdd31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.274+0000 7f133b7fe640 0 client.25369 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 shutdown_connections 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f13655f5740 1 -- 172.21.15.18:0/1497283655 wait complete. 2024-09-19T08:51:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f13655f5740 20 client.25369 trim_cache size 0 max 16384 2024-09-19T08:51:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:51:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:51:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:51:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f13440a3370 msgr2=0x7f13440a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f13440a3370 0x7f13440a5830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f134c09bfe0 tx=0x7f134c0d3a00 comp rx=0 tx=0).stop 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 msgr2=0x7f135c1a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 0x7f135c1a2670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f134c00e9f0 tx=0x7f134c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 shutdown_connections 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f13440a3370 0x7f13440a5830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f135c109700 0x7f135c1a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f135c0736c0 0x7f135c1a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 --2- 172.21.15.18:0/2979685661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f135c072d20 0x7f135c1a2670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 >> 172.21.15.18:0/2979685661 conn(0x7f135c06ece0 msgr2=0x7f135c071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.275+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 shutdown_connections 2024-09-19T08:51:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:28.276+0000 7f136285a640 1 -- 172.21.15.18:0/2979685661 wait complete. 2024-09-19T08:51:30.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:29 smithi150 ceph-mon[34610]: pgmap v535: 129 pgs: 129 active+clean; 55 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 573 op/s 2024-09-19T08:51:30.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:29 smithi162 ceph-mon[34870]: pgmap v535: 129 pgs: 129 active+clean; 55 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 573 op/s 2024-09-19T08:51:30.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:29 smithi018 ceph-mon[30956]: pgmap v535: 129 pgs: 129 active+clean; 55 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 573 op/s 2024-09-19T08:51:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:31 smithi150 ceph-mon[34610]: pgmap v536: 129 pgs: 129 active+clean; 51 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 642 op/s 2024-09-19T08:51:32.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:31 smithi162 ceph-mon[34870]: pgmap v536: 129 pgs: 129 active+clean; 51 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 642 op/s 2024-09-19T08:51:32.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:31 smithi018 ceph-mon[30956]: pgmap v536: 129 pgs: 129 active+clean; 51 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 642 op/s 2024-09-19T08:51:34.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:33 smithi150 ceph-mon[34610]: pgmap v537: 129 pgs: 129 active+clean; 51 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 627 op/s 2024-09-19T08:51:34.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:33 smithi162 ceph-mon[34870]: pgmap v537: 129 pgs: 129 active+clean; 51 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 627 op/s 2024-09-19T08:51:34.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:33 smithi018 ceph-mon[30956]: pgmap v537: 129 pgs: 129 active+clean; 51 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 627 op/s 2024-09-19T08:51:36.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:35 smithi150 ceph-mon[34610]: pgmap v538: 129 pgs: 129 active+clean; 49 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-19T08:51:36.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:35 smithi162 ceph-mon[34870]: pgmap v538: 129 pgs: 129 active+clean; 49 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-19T08:51:36.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:35 smithi018 ceph-mon[30956]: pgmap v538: 129 pgs: 129 active+clean; 49 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-19T08:51:38.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:37 smithi150 ceph-mon[34610]: pgmap v539: 129 pgs: 129 active+clean; 52 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 668 op/s 2024-09-19T08:51:38.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:37 smithi162 ceph-mon[34870]: pgmap v539: 129 pgs: 129 active+clean; 52 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 668 op/s 2024-09-19T08:51:38.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:37 smithi018 ceph-mon[30956]: pgmap v539: 129 pgs: 129 active+clean; 52 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.9 MiB/s wr, 668 op/s 2024-09-19T08:51:40.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:39 smithi162 ceph-mon[34870]: pgmap v540: 129 pgs: 129 active+clean; 67 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.5 MiB/s wr, 595 op/s 2024-09-19T08:51:40.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:39 smithi018 ceph-mon[30956]: pgmap v540: 129 pgs: 129 active+clean; 67 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.5 MiB/s wr, 595 op/s 2024-09-19T08:51:40.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:39 smithi150 ceph-mon[34610]: pgmap v540: 129 pgs: 129 active+clean; 67 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.5 MiB/s wr, 595 op/s 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/3162175496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f00736c0 msgr2=0x7ff2f0119130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/3162175496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f00736c0 0x7ff2f0119130 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009900 tx=0x7ff2e002a410 comp rx=0 tx=0).stop 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/3162175496 shutdown_connections 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/3162175496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f00736c0 0x7ff2f0119130 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/3162175496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f0072d20 0x7ff2f0073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/3162175496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2f0109700 0x7ff2f0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/3162175496 >> 172.21.15.18:0/3162175496 conn(0x7ff2f006ece0 msgr2=0x7ff2f0071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/3162175496 shutdown_connections 2024-09-19T08:51:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.405+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/3162175496 wait complete. 2024-09-19T08:51:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 Processor -- start 2024-09-19T08:51:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 -- start start 2024-09-19T08:51:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f0072d20 0x7ff2f01a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f00736c0 0x7ff2f01a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2f0109700 0x7ff2f01ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f011c460 con 0x7ff2f0072d20 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f011c2e0 con 0x7ff2f00736c0 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.406+0000 7ff2f5e8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f011c5e0 con 0x7ff2f0109700 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f00736c0 0x7ff2f01a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f00736c0 0x7ff2f01a6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:59328/0 (socket says 172.21.15.18:59328) 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2eeffd640 1 -- 172.21.15.18:0/2631747739 learned_addr learned my addr 172.21.15.18:0/2631747739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f0072d20 0x7ff2f01a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2631747739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2f0109700 msgr2=0x7ff2f01ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2f0109700 0x7ff2f01ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.407+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2631747739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f00736c0 msgr2=0x7ff2f01a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.408+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f00736c0 0x7ff2f01a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.408+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2631747739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f01ae6a0 con 0x7ff2f0072d20 2024-09-19T08:51:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.408+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f0072d20 0x7ff2f01a6a80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009fd0 tx=0x7ff2e800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.409+0000 7ff2ecff9640 1 -- 172.21.15.18:0/2631747739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8004b20 con 0x7ff2f0072d20 2024-09-19T08:51:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.409+0000 7ff2ecff9640 1 -- 172.21.15.18:0/2631747739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2e8004cc0 con 0x7ff2f0072d20 2024-09-19T08:51:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.410+0000 7ff2ecff9640 1 -- 172.21.15.18:0/2631747739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8010720 con 0x7ff2f0072d20 2024-09-19T08:51:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.410+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f01ae990 con 0x7ff2f0072d20 2024-09-19T08:51:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.410+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f01aee60 con 0x7ff2f0072d20 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.413+0000 7ff2f8c27740 1 Processor -- start 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 -- start start 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b6370 0x5603ec1b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5603ec1142f0 con 0x5603ec1b6370 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5603ec0bc270 con 0x5603ec1b09a0 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.414+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5603ec1102b0 con 0x5603ec1b12e0 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2effff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b6370 0x5603ec1b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2effff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:59330/0 (socket says 172.21.15.18:59330) 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2effff640 1 -- 172.21.15.18:0/1995041262 learned_addr learned my addr 172.21.15.18:0/1995041262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2eeffd640 1 -- 172.21.15.18:0/1995041262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 msgr2=0x5603ec1b5da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1b5da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2eeffd640 1 -- 172.21.15.18:0/1995041262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 msgr2=0x5603ec1b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2eeffd640 1 -- 172.21.15.18:0/1995041262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ec0bb340 con 0x5603ec1b6370 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2effff640 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.415+0000 7ff2ecff9640 1 -- 172.21.15.18:0/2631747739 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff2e8005000 con 0x7ff2f0072d20 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.416+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b6370 0x5603ec1b8830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff2f01a7f90 tx=0x7ff2e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8092e97857f2341d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.416+0000 7ff2d5ffb640 1 -- 172.21.15.18:0/1995041262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004230 con 0x5603ec1b6370 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.416+0000 7ff2d5ffb640 1 -- 172.21.15.18:0/1995041262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2e40043d0 con 0x5603ec1b6370 2024-09-19T08:51:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.416+0000 7ff2d5ffb640 1 -- 172.21.15.18:0/1995041262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004d10 con 0x5603ec1b6370 2024-09-19T08:51:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.416+0000 7ff2ecff9640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2d80a3330 0x7ff2d80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2ecff9640 1 -- 172.21.15.18:0/2631747739 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff2e809a1c0 con 0x7ff2f0072d20 2024-09-19T08:51:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 -- 172.21.15.18:0/1995041262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b6370 msgr2=0x5603ec1b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b6370 0x5603ec1b8830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff2f01a7f90 tx=0x7ff2e4011810 comp rx=0 tx=0).stop 2024-09-19T08:51:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 -- 172.21.15.18:0/1995041262 shutdown_connections 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b6370 0x5603ec1b8830 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/1995041262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2f8c27740 1 -- 172.21.15.18:0/1995041262 >> 172.21.15.18:0/1995041262 conn(0x5603ec1ac010 msgr2=0x5603ec1ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.417+0000 7ff2effff640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2d80a3330 0x7ff2d80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.418+0000 7ff2f8c27740 1 -- 172.21.15.18:0/1995041262 shutdown_connections 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.418+0000 7ff2f8c27740 1 -- 172.21.15.18:0/1995041262 wait complete. 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.418+0000 7ff2f8c27740 1 -- start start 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 Processor -- start 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2effff640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2d80a3330 0x7ff2d80a57f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009230 tx=0x7ff2e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b12e0 0x5603ec1bb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b6370 0x5603ec1c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5603ec1b9340 con 0x5603ec1b09a0 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5603ec09d290 con 0x5603ec1b12e0 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5603ec1b94c0 con 0x5603ec1b6370 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2f8c27740 10 client.0 _ll_register_callbacks cb 0x5603ec0ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1babf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38910/0 (socket says 172.21.15.18:38910) 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2693453792 learned_addr learned my addr 172.21.15.18:0/2693453792 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b12e0 0x5603ec1bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.419+0000 7ff2effff640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b6370 0x5603ec1c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2693453792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b6370 msgr2=0x5603ec1c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b6370 0x5603ec1c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b12e0 msgr2=0x5603ec1bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b12e0 0x5603ec1bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ef7fe640 1 -- 172.21.15.18:0/2693453792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ebe27210 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1babf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8012020 tx=0x7ff2e8096c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd9185df839e7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ceffd640 1 -- 172.21.15.18:0/2693453792 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8098b50 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2ceffd640 1 -- 172.21.15.18:0/2693453792 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff2e80a4cd0 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.420+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e40043d0 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2ceffd640 1 -- 172.21.15.18:0/2693453792 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff2e8098cf0 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 10 client.15660 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5603ebef3620 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2ceffd640 1 -- 172.21.15.18:0/2693453792 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2e40043d0 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2ceffd640 1 -- 172.21.15.18:0/2693453792 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff2e80981f0 con 0x5603ec1b09a0 2024-09-19T08:51:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 10 client.15660 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 20 client.15660 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1c6890 0x5603ec1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 4 client.15660 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603ec121a20 con 0x5603ec1c6890 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.421+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1c6890 0x5603ec1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.422+0000 7ff2ceffd640 10 client.15660 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.422+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1c6890 0x5603ec1c8d00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d612756353c235 server_cookie=ff9f3a00deb91fa1 in_seq=0 out_seq=0 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.422+0000 7ff2ceffd640 1 -- 172.21.15.18:0/2693453792 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603ec121a20 con 0x5603ec1c6890 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.422+0000 7ff2ceffd640 10 client.15660 handle_command_reply: tid=0 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 client.15660 shutdown 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 msgr2=0x5603ec1babf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1babf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8012020 tx=0x7ff2e8096c20 comp rx=0 tx=0).stop 2024-09-19T08:51:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 shutdown_connections 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1c6890 0x5603ec1c8d00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b6370 0x5603ec1c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2ceffd640 0 client.15660 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b12e0 0x5603ec1bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2693453792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1babf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 >> 172.21.15.18:0/2693453792 conn(0x5603ec1ac010 msgr2=0x5603ec1ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 shutdown_connections 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2693453792 wait complete. 2024-09-19T08:51:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.423+0000 7ff2f8c27740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.447+0000 7ff2f8c27740 1 Processor -- start 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.447+0000 7ff2f8c27740 1 -- start start 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.447+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1ac010 0x5603ec1bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.447+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38926/0 (socket says 172.21.15.18:38926) 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 -- 172.21.15.18:0/2149055269 learned_addr learned my addr 172.21.15.18:0/2149055269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f007c5e0 con 0x5603ec1b09a0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f007ee80 con 0x5603ec1ac010 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f007cc70 con 0x5603ec1b12e0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2effff640 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1ac010 0x5603ec1bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 -- 172.21.15.18:0/2149055269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 msgr2=0x5603ec1acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 -- 172.21.15.18:0/2149055269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1ac010 msgr2=0x5603ec1bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1ac010 0x5603ec1bb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 -- 172.21.15.18:0/2149055269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ec1a72d0 con 0x5603ec1b09a0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1ac010 0x5603ec1bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.448+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1c2130 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009bd0 tx=0x7ff2e4009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e2430c07b9ef4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2d57fa640 1 -- 172.21.15.18:0/2149055269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004040 con 0x5603ec1b09a0 2024-09-19T08:51:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2d57fa640 1 -- 172.21.15.18:0/2149055269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2e402b070 con 0x5603ec1b09a0 2024-09-19T08:51:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2d57fa640 1 -- 172.21.15.18:0/2149055269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4026470 con 0x5603ec1b09a0 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 msgr2=0x5603ec1c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1c2130 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009bd0 tx=0x7ff2e4009590 comp rx=0 tx=0).stop 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 shutdown_connections 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1b12e0 0x5603ec1acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b09a0 0x5603ec1c2130 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/2149055269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1ac010 0x5603ec1bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 >> 172.21.15.18:0/2149055269 conn(0x5603ec1b1da0 msgr2=0x5603ec1ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 shutdown_connections 2024-09-19T08:51:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.449+0000 7ff2f8c27740 1 -- 172.21.15.18:0/2149055269 wait complete. 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 -- start start 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 Processor -- start 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1ac010 0x5603ec1bfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1c0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 0x5603ec1c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f007d340 con 0x5603ec1b12e0 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f007e7b0 con 0x5603ec1b09a0 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f007da10 con 0x5603ec1ac010 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2f8c27740 10 client.0 _ll_register_callbacks cb 0x7ff2e4009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 0x5603ec1c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 0x5603ec1c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38940/0 (socket says 172.21.15.18:38940) 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2effff640 1 -- 172.21.15.18:0/937308239 learned_addr learned my addr 172.21.15.18:0/937308239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.450+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1ac010 0x5603ec1bfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2effff640 1 -- 172.21.15.18:0/937308239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1ac010 msgr2=0x5603ec1bfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2effff640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1ac010 0x5603ec1bfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2effff640 1 -- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 msgr2=0x5603ec1c0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2effff640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1c0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2effff640 1 -- 172.21.15.18:0/937308239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ec1c1870 con 0x5603ec1b12e0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2eeffd640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2effff640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 0x5603ec1c1260 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005ab0 tx=0x7ff2e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd396f3257613b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2ceffd640 1 -- 172.21.15.18:0/937308239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0035040 con 0x5603ec1b12e0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2ceffd640 1 -- 172.21.15.18:0/937308239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff2e0005040 con 0x5603ec1b12e0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e402b070 con 0x5603ec1b12e0 2024-09-19T08:51:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2ceffd640 1 -- 172.21.15.18:0/937308239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff2e007f050 con 0x5603ec1b12e0 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2f8c27740 10 client.15666 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.451+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5603ec231a00 con 0x5603ec1b12e0 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2ceffd640 1 -- 172.21.15.18:0/937308239 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2e402b070 con 0x5603ec1b12e0 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2ceffd640 1 -- 172.21.15.18:0/937308239 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff2e0074020 con 0x5603ec1b12e0 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2f8c27740 10 client.15666 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2f8c27740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2f8c27740 20 client.15666 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1b6370 0x5603ec2343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2f8c27740 4 client.15666 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603ec11bd70 con 0x5603ec1b6370 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1b6370 0x5603ec2343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.452+0000 7ff2ceffd640 10 client.15666 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.453+0000 7ff2ef7fe640 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1b6370 0x5603ec2343f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=817b2f3376c50e19 server_cookie=14c047dc645af22d in_seq=0 out_seq=0 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2ceffd640 1 -- 172.21.15.18:0/937308239 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603ec11bd70 con 0x5603ec1b6370 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2ceffd640 10 client.15666 handle_command_reply: tid=0 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 client.15666 shutdown 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 msgr2=0x5603ec1c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 0x5603ec1c1260 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005ab0 tx=0x7ff2e0005fd0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 shutdown_connections 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5603ec1b6370 0x5603ec2343f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603ec1b12e0 0x5603ec1c1260 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2ceffd640 0 client.15666 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.472+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5603ec1b09a0 0x5603ec1c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.473+0000 7ff2f8c27740 1 --2- 172.21.15.18:0/937308239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603ec1ac010 0x5603ec1bfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.473+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 >> 172.21.15.18:0/937308239 conn(0x5603ec1b1da0 msgr2=0x5603ec1aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.473+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 shutdown_connections 2024-09-19T08:51:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.473+0000 7ff2f8c27740 1 -- 172.21.15.18:0/937308239 wait complete. 2024-09-19T08:51:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.473+0000 7ff2f8c27740 20 client.15666 trim_cache size 0 max 16384 2024-09-19T08:51:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:51:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:51:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:51:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.474+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2d80a3330 msgr2=0x7ff2d80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.474+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2d80a3330 0x7ff2d80a57f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009230 tx=0x7ff2e0005a20 comp rx=0 tx=0).stop 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f0072d20 msgr2=0x7ff2f01a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f0072d20 0x7ff2f01a6a80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009fd0 tx=0x7ff2e800ef90 comp rx=0 tx=0).stop 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 shutdown_connections 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff2d80a3330 0x7ff2d80a57f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2f0109700 0x7ff2f01ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2f00736c0 0x7ff2f01a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 --2- 172.21.15.18:0/2631747739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2f0072d20 0x7ff2f01a6a80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 >> 172.21.15.18:0/2631747739 conn(0x7ff2f006ece0 msgr2=0x7ff2f0071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 shutdown_connections 2024-09-19T08:51:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:41.475+0000 7ff2f5e8d640 1 -- 172.21.15.18:0/2631747739 wait complete. 2024-09-19T08:51:42.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:41 smithi162 ceph-mon[34870]: pgmap v541: 129 pgs: 129 active+clean; 69 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 655 op/s 2024-09-19T08:51:42.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:41 smithi018 ceph-mon[30956]: pgmap v541: 129 pgs: 129 active+clean; 69 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 655 op/s 2024-09-19T08:51:42.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:41 smithi150 ceph-mon[34610]: pgmap v541: 129 pgs: 129 active+clean; 69 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 655 op/s 2024-09-19T08:51:44.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:43 smithi162 ceph-mon[34870]: pgmap v542: 129 pgs: 129 active+clean; 60 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.6 MiB/s wr, 630 op/s 2024-09-19T08:51:44.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:43 smithi018 ceph-mon[30956]: pgmap v542: 129 pgs: 129 active+clean; 60 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.6 MiB/s wr, 630 op/s 2024-09-19T08:51:44.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:43 smithi150 ceph-mon[34610]: pgmap v542: 129 pgs: 129 active+clean; 60 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.6 MiB/s wr, 630 op/s 2024-09-19T08:51:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:45 smithi162 ceph-mon[34870]: pgmap v543: 129 pgs: 129 active+clean; 61 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 539 op/s 2024-09-19T08:51:46.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:45 smithi018 ceph-mon[30956]: pgmap v543: 129 pgs: 129 active+clean; 61 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 539 op/s 2024-09-19T08:51:46.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:45 smithi150 ceph-mon[34610]: pgmap v543: 129 pgs: 129 active+clean; 61 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 539 op/s 2024-09-19T08:51:48.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:47 smithi162 ceph-mon[34870]: pgmap v544: 129 pgs: 129 active+clean; 75 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 642 op/s 2024-09-19T08:51:48.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:47 smithi018 ceph-mon[30956]: pgmap v544: 129 pgs: 129 active+clean; 75 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 642 op/s 2024-09-19T08:51:48.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:47 smithi150 ceph-mon[34610]: pgmap v544: 129 pgs: 129 active+clean; 75 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 642 op/s 2024-09-19T08:51:50.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:49 smithi162 ceph-mon[34870]: pgmap v545: 129 pgs: 129 active+clean; 76 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-09-19T08:51:50.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:49 smithi018 ceph-mon[30956]: pgmap v545: 129 pgs: 129 active+clean; 76 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-09-19T08:51:50.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:49 smithi150 ceph-mon[34610]: pgmap v545: 129 pgs: 129 active+clean; 76 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-09-19T08:51:51.580 INFO:tasks.workunit.client.0.smithi018.stdout:fallocating to largest ever: 0x6400000 2024-09-19T08:51:52.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:51 smithi162 ceph-mon[34870]: pgmap v546: 129 pgs: 129 active+clean; 65 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 615 op/s 2024-09-19T08:51:52.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:51 smithi018 ceph-mon[30956]: pgmap v546: 129 pgs: 129 active+clean; 65 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 615 op/s 2024-09-19T08:51:52.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:51 smithi150 ceph-mon[34610]: pgmap v546: 129 pgs: 129 active+clean; 65 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 615 op/s 2024-09-19T08:51:54.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:53 smithi162 ceph-mon[34870]: pgmap v547: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.5 MiB/s wr, 603 op/s 2024-09-19T08:51:54.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:53 smithi018 ceph-mon[30956]: pgmap v547: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.5 MiB/s wr, 603 op/s 2024-09-19T08:51:54.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:53 smithi150 ceph-mon[34610]: pgmap v547: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.5 MiB/s wr, 603 op/s 2024-09-19T08:51:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.602+0000 7f7c1effd640 1 -- 172.21.15.18:0/1455914233 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10031880 con 0x7f7c20100a60 2024-09-19T08:51:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.602+0000 7f7c2640e640 1 -- 172.21.15.18:0/1455914233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 msgr2=0x7f7c20100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.602+0000 7f7c2640e640 1 --2- 172.21.15.18:0/1455914233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20100e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009900 tx=0x7f7c1002a410 comp rx=0 tx=0).stop 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.602+0000 7f7c2640e640 1 -- 172.21.15.18:0/1455914233 shutdown_connections 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 --2- 172.21.15.18:0/1455914233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c20102610 0x7f7c20108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 --2- 172.21.15.18:0/1455914233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c20101c50 0x7f7c201020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 --2- 172.21.15.18:0/1455914233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20100e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 -- 172.21.15.18:0/1455914233 >> 172.21.15.18:0/1455914233 conn(0x7f7c200fc1e0 msgr2=0x7f7c200fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 -- 172.21.15.18:0/1455914233 shutdown_connections 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 -- 172.21.15.18:0/1455914233 wait complete. 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 Processor -- start 2024-09-19T08:51:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.603+0000 7f7c2640e640 1 -- start start 2024-09-19T08:51:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c2640e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c2640e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c20101c50 0x7f7c201971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c2640e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c20102610 0x7f7c2019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c2640e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2010c5c0 con 0x7f7c20102610 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c2640e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2010c440 con 0x7f7c20101c50 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c2640e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2010c740 con 0x7f7c20100a60 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c20101c50 0x7f7c201971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c249ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c20102610 0x7f7c2019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:39656/0 (socket says 172.21.15.18:39656) 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 -- 172.21.15.18:0/2210967828 learned_addr learned my addr 172.21.15.18:0/2210967828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 -- 172.21.15.18:0/2210967828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c20101c50 msgr2=0x7f7c201971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c20101c50 0x7f7c201971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 -- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c20102610 msgr2=0x7f7c2019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c20102610 0x7f7c2019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.604+0000 7f7c1ffff640 1 -- 172.21.15.18:0/2210967828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2019e880 con 0x7f7c20100a60 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.605+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20196c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c10005ab0 tx=0x7f7c10003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.605+0000 7f7c1d7fa640 1 -- 172.21.15.18:0/2210967828 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1003f070 con 0x7f7c20100a60 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.605+0000 7f7c1d7fa640 1 -- 172.21.15.18:0/2210967828 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c10031c30 con 0x7f7c20100a60 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.605+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2019eb10 con 0x7f7c20100a60 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.605+0000 7f7c1d7fa640 1 -- 172.21.15.18:0/2210967828 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10035030 con 0x7f7c20100a60 2024-09-19T08:51:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.605+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2019f050 con 0x7f7c20100a60 2024-09-19T08:51:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.607+0000 7f7c1d7fa640 1 -- 172.21.15.18:0/2210967828 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7c10042070 con 0x7f7c20100a60 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 Processor -- start 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c1d7fa640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c080a33c0 0x7f7c080a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 -- start start 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c1d7fa640 1 -- 172.21.15.18:0/2210967828 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7c100f0540 con 0x7f7c20100a60 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c249ab640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c080a33c0 0x7f7c080a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56263372d2f0 con 0x5626337caf10 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5626336d5270 con 0x5626337ca1d0 2024-09-19T08:51:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c29286740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5626337292b0 con 0x5626337cb310 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33618/0 (socket says 172.21.15.18:33618) 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3310909416 learned_addr learned my addr 172.21.15.18:0/3310909416 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.608+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c249ab640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1f7fe640 1 -- 172.21.15.18:0/3310909416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 msgr2=0x5626337da460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337da460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1f7fe640 1 -- 172.21.15.18:0/3310909416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 msgr2=0x5626337c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1f7fe640 1 -- 172.21.15.18:0/3310909416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626336d4340 con 0x5626337cb310 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c249ab640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c249ab640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c080a33c0 0x7f7c080a5880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005fd0 tx=0x7f7c18013b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337c9c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400bbf0 tx=0x7f7c140107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24f6dad68157aeb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c067fc640 1 -- 172.21.15.18:0/3310909416 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14004030 con 0x5626337cb310 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c067fc640 1 -- 172.21.15.18:0/3310909416 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c140035f0 con 0x5626337cb310 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.609+0000 7f7c067fc640 1 -- 172.21.15.18:0/3310909416 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14011680 con 0x5626337cb310 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 -- 172.21.15.18:0/3310909416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 msgr2=0x5626337c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337c9c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400bbf0 tx=0x7f7c140107a0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 -- 172.21.15.18:0/3310909416 shutdown_connections 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337c9c90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 --2- 172.21.15.18:0/3310909416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 -- 172.21.15.18:0/3310909416 >> 172.21.15.18:0/3310909416 conn(0x5626337c5010 msgr2=0x5626337c5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 -- 172.21.15.18:0/3310909416 shutdown_connections 2024-09-19T08:51:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 -- 172.21.15.18:0/3310909416 wait complete. 2024-09-19T08:51:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.610+0000 7f7c29286740 1 -- start start 2024-09-19T08:51:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 Processor -- start 2024-09-19T08:51:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 0x5626337dc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337dc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 0x5626337dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626337dab80 con 0x5626337cb310 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 0x5626337dc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:39674/0 (socket says 172.21.15.18:39674) 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5626336b6290 con 0x5626337caf10 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3653233627 learned_addr learned my addr 172.21.15.18:0/3653233627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c249ab640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.611+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5626337dad00 con 0x5626337ca1d0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c29286740 10 client.0 _ll_register_callbacks cb 0x5626336e7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 msgr2=0x5626337dc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337dc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3653233627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 msgr2=0x5626337e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3653233627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562633440210 con 0x5626337ca1d0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.612+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 0x5626337dc440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c100b9180 tx=0x7f7c100091c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78fc2ed784df9523 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.615+0000 7f7bff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.615+0000 7f7bff7fe640 1 -- 172.21.15.18:0/3653233627 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10049040 con 0x5626337ca1d0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.615+0000 7f7bff7fe640 1 -- 172.21.15.18:0/3653233627 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7c100f01b0 con 0x5626337ca1d0 2024-09-19T08:51:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.615+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c140035f0 con 0x5626337ca1d0 2024-09-19T08:51:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.619+0000 7f7bff7fe640 1 -- 172.21.15.18:0/3653233627 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c100ba980 con 0x5626337ca1d0 2024-09-19T08:51:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.621+0000 7f7c29286740 10 client.25393 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.621+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56263350c620 con 0x5626337ca1d0 2024-09-19T08:51:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.622+0000 7f7bff7fe640 1 -- 172.21.15.18:0/3653233627 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c140035f0 con 0x5626337ca1d0 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7bff7fe640 1 -- 172.21.15.18:0/3653233627 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c100bcaa0 con 0x5626337ca1d0 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c29286740 10 client.25393 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c29286740 10 client.25393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c29286740 20 client.25393 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c29286740 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5626337e8010 0x5626337ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c29286740 4 client.25393 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56263373aa20 con 0x5626337e8010 2024-09-19T08:51:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.623+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5626337e8010 0x5626337ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.625+0000 7f7c1f7fe640 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5626337e8010 0x5626337ea4a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d25b75f51bcfe015 server_cookie=7d5eaebf30cc4ab3 in_seq=0 out_seq=0 2024-09-19T08:51:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.625+0000 7f7bff7fe640 10 client.25393 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.627+0000 7f7bff7fe640 1 -- 172.21.15.18:0/3653233627 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56263373aa20 con 0x5626337e8010 2024-09-19T08:51:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.627+0000 7f7bff7fe640 10 client.25393 handle_command_reply: tid=0 2024-09-19T08:51:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.627+0000 7f7c29286740 1 client.25393 shutdown 2024-09-19T08:51:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.628+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 msgr2=0x5626337dc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.628+0000 7f7c29286740 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 0x5626337dc440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c100b9180 tx=0x7f7c100091c0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 shutdown_connections 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x5626337e8010 0x5626337ea4a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 --2- 172.21.15.18:0/3653233627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337ca1d0 0x5626337dc440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 >> 172.21.15.18:0/3653233627 conn(0x5626337c5010 msgr2=0x5626337c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7bff7fe640 0 client.25393 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 shutdown_connections 2024-09-19T08:51:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 1 -- 172.21.15.18:0/3653233627 wait complete. 2024-09-19T08:51:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.629+0000 7f7c29286740 20 client.25393 trim_cache size 0 max 16384 2024-09-19T08:51:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.651+0000 7f7c29286740 1 Processor -- start 2024-09-19T08:51:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.652+0000 7f7c29286740 1 -- start start 2024-09-19T08:51:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.652+0000 7f7c29286740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.652+0000 7f7c29286740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.652+0000 7f7c29286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.652+0000 7f7c29286740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201a6580 con 0x5626337caf10 2024-09-19T08:51:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c29286740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201a8e00 con 0x5626337ca1d0 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c29286740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201a6bf0 con 0x5626337cb310 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c249ab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:37216/0 (socket says 172.21.15.18:37216) 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3111671610 learned_addr learned my addr 172.21.15.18:0/3111671610 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3111671610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 msgr2=0x5626337e38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337e38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3111671610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 msgr2=0x5626337c5930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:51:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c5930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 -- 172.21.15.18:0/3111671610 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626337c4e40 con 0x5626337ca1d0 2024-09-19T08:51:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.653+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337c53f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c100edfe0 tx=0x7f7c100bad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5083e329c35f8154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.655+0000 7f7c05ffb640 1 -- 172.21.15.18:0/3111671610 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10031de0 con 0x5626337ca1d0 2024-09-19T08:51:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.655+0000 7f7c05ffb640 1 -- 172.21.15.18:0/3111671610 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c100d5070 con 0x5626337ca1d0 2024-09-19T08:51:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.655+0000 7f7c05ffb640 1 -- 172.21.15.18:0/3111671610 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c100c5400 con 0x5626337ca1d0 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 -- 172.21.15.18:0/3111671610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 msgr2=0x5626337c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337c53f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c100edfe0 tx=0x7f7c100bad50 comp rx=0 tx=0).stop 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 -- 172.21.15.18:0/3111671610 shutdown_connections 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626337cb310 0x5626337e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337caf10 0x5626337c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 --2- 172.21.15.18:0/3111671610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337ca1d0 0x5626337c53f0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c100edfe0 tx=0x7f7c100bad50 comp rx=0 tx=0).stop 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 -- 172.21.15.18:0/3111671610 >> 172.21.15.18:0/3111671610 conn(0x5626337c5010 msgr2=0x5626337cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 -- 172.21.15.18:0/3111671610 shutdown_connections 2024-09-19T08:51:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.656+0000 7f7c29286740 1 -- 172.21.15.18:0/3111671610 wait complete. 2024-09-19T08:51:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.657+0000 7f7c29286740 1 -- start start 2024-09-19T08:51:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.657+0000 7f7c29286740 1 Processor -- start 2024-09-19T08:51:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56263384ed30 0x562633851120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33634/0 (socket says 172.21.15.18:33634) 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c1f7fe640 1 -- 172.21.15.18:0/2469499948 learned_addr learned my addr 172.21.15.18:0/2469499948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201a72c0 con 0x5626337cb310 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201a8730 con 0x5626337caf10 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201a7990 con 0x56263384ed30 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c249ab640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56263384ed30 0x562633851120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c29286740 10 client.0 _ll_register_callbacks cb 0x7f7c100edbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c249ab640 1 -- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 msgr2=0x5626337e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c249ab640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c249ab640 1 -- 172.21.15.18:0/2469499948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 msgr2=0x5626337e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c249ab640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.658+0000 7f7c249ab640 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562633851660 con 0x56263384ed30 2024-09-19T08:51:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.659+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c100d5070 con 0x56263384ed30 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.659+0000 7f7c249ab640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56263384ed30 0x562633851120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800f790 tx=0x7f7c18004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a0a7ebbe5e332b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.659+0000 7f7bff7fe640 10 client.25399 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.660+0000 7f7bff7fe640 1 -- 172.21.15.18:0/2469499948 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c180047c0 con 0x56263384ed30 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.660+0000 7f7bff7fe640 1 -- 172.21.15.18:0/2469499948 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7c18004b20 con 0x56263384ed30 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.660+0000 7f7bff7fe640 1 -- 172.21.15.18:0/2469499948 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c18004d60 con 0x56263384ed30 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.660+0000 7f7c29286740 10 client.25399 fetch_fsmap learned FSMap version 21 2024-09-19T08:51:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.660+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=21}) -- 0x562633874700 con 0x56263384ed30 2024-09-19T08:51:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7bff7fe640 1 -- 172.21.15.18:0/2469499948 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c18029070 con 0x56263384ed30 2024-09-19T08:51:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7c29286740 10 client.25399 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:51:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7c29286740 10 client.25399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7c29286740 20 client.25399 populate_metadata read hostname 'smithi018' 2024-09-19T08:51:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7c29286740 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562633874fb0 0x5626338773d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7c29286740 4 client.25399 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:51:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.662+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562633734d70 con 0x562633874fb0 2024-09-19T08:51:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.663+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562633874fb0 0x5626338773d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.663+0000 7f7c1ffff640 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562633874fb0 0x5626338773d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b261bdd79471616 server_cookie=2e15642cc4726cee in_seq=0 out_seq=0 2024-09-19T08:51:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.663+0000 7f7bff7fe640 10 client.25399 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7bff7fe640 1 -- 172.21.15.18:0/2469499948 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562633734d70 con 0x562633874fb0 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7bff7fe640 10 client.25399 handle_command_reply: tid=0 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 client.25399 shutdown 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56263384ed30 msgr2=0x562633851120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56263384ed30 0x562633851120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800f790 tx=0x7f7c18004ab0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 shutdown_connections 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x562633874fb0 0x5626338773d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56263384ed30 0x562633851120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626337cb310 0x5626337e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 --2- 172.21.15.18:0/2469499948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626337caf10 0x5626337e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7bff7fe640 0 client.25399 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:51:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.680+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 >> 172.21.15.18:0/2469499948 conn(0x5626337c5010 msgr2=0x5626337c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 shutdown_connections 2024-09-19T08:51:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c29286740 1 -- 172.21.15.18:0/2469499948 wait complete. 2024-09-19T08:51:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c29286740 20 client.25399 trim_cache size 0 max 16384 2024-09-19T08:51:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:51:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:51:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:51:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c080a33c0 msgr2=0x7f7c080a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c080a33c0 0x7f7c080a5880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005fd0 tx=0x7f7c18013b40 comp rx=0 tx=0).stop 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 msgr2=0x7f7c20196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20196c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c10005ab0 tx=0x7f7c10003c20 comp rx=0 tx=0).stop 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 shutdown_connections 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c080a33c0 0x7f7c080a5880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c20102610 0x7f7c2019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c20101c50 0x7f7c201971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 --2- 172.21.15.18:0/2210967828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c20100a60 0x7f7c20196c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.681+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 >> 172.21.15.18:0/2210967828 conn(0x7f7c200fc1e0 msgr2=0x7f7c20104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.682+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 shutdown_connections 2024-09-19T08:51:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:51:54.682+0000 7f7c2640e640 1 -- 172.21.15.18:0/2210967828 wait complete. 2024-09-19T08:51:56.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:55 smithi162 ceph-mon[34870]: pgmap v548: 129 pgs: 129 active+clean; 59 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.3 MiB/s wr, 522 op/s 2024-09-19T08:51:56.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:55 smithi018 ceph-mon[30956]: pgmap v548: 129 pgs: 129 active+clean; 59 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.3 MiB/s wr, 522 op/s 2024-09-19T08:51:56.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:55 smithi150 ceph-mon[34610]: pgmap v548: 129 pgs: 129 active+clean; 59 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.3 MiB/s wr, 522 op/s 2024-09-19T08:51:57.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:56 smithi162 ceph-mon[34870]: pgmap v549: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 633 op/s 2024-09-19T08:51:57.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:56 smithi018 ceph-mon[30956]: pgmap v549: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 633 op/s 2024-09-19T08:51:57.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:56 smithi150 ceph-mon[34610]: pgmap v549: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 633 op/s 2024-09-19T08:51:59.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:51:59 smithi150 ceph-mon[34610]: pgmap v550: 129 pgs: 129 active+clean; 68 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-19T08:51:59.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:51:59 smithi162 ceph-mon[34870]: pgmap v550: 129 pgs: 129 active+clean; 68 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-19T08:51:59.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:51:59 smithi018 ceph-mon[30956]: pgmap v550: 129 pgs: 129 active+clean; 68 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-19T08:52:01.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:01 smithi150 ceph-mon[34610]: pgmap v551: 129 pgs: 129 active+clean; 72 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 616 op/s 2024-09-19T08:52:01.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:01 smithi162 ceph-mon[34870]: pgmap v551: 129 pgs: 129 active+clean; 72 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 616 op/s 2024-09-19T08:52:01.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:01 smithi018 ceph-mon[30956]: pgmap v551: 129 pgs: 129 active+clean; 72 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 616 op/s 2024-09-19T08:52:03.007 INFO:tasks.workunit.client.0.smithi018.stdout:40000 falloc from 0x4cbeead to 0x4cc78f9 (0x8a4c bytes) 2024-09-19T08:52:03.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:03 smithi162 ceph-mon[34870]: pgmap v552: 129 pgs: 129 active+clean; 58 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 607 op/s 2024-09-19T08:52:03.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:03 smithi018 ceph-mon[30956]: pgmap v552: 129 pgs: 129 active+clean; 58 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 607 op/s 2024-09-19T08:52:03.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:03 smithi150 ceph-mon[34610]: pgmap v552: 129 pgs: 129 active+clean; 58 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.6 MiB/s wr, 607 op/s 2024-09-19T08:52:05.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:05 smithi162 ceph-mon[34870]: pgmap v553: 129 pgs: 129 active+clean; 54 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 522 op/s 2024-09-19T08:52:05.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:05 smithi018 ceph-mon[30956]: pgmap v553: 129 pgs: 129 active+clean; 54 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 522 op/s 2024-09-19T08:52:05.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:05 smithi150 ceph-mon[34610]: pgmap v553: 129 pgs: 129 active+clean; 54 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 522 op/s 2024-09-19T08:52:07.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:07 smithi162 ceph-mon[34870]: pgmap v554: 129 pgs: 129 active+clean; 65 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.7 MiB/s wr, 634 op/s 2024-09-19T08:52:07.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:07 smithi018 ceph-mon[30956]: pgmap v554: 129 pgs: 129 active+clean; 65 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.7 MiB/s wr, 634 op/s 2024-09-19T08:52:07.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:07 smithi150 ceph-mon[34610]: pgmap v554: 129 pgs: 129 active+clean; 65 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.7 MiB/s wr, 634 op/s 2024-09-19T08:52:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/884916427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24102d50 msgr2=0x7f7c241031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/884916427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24102d50 0x7f7c241031d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009860 tx=0x7f7c1402a340 comp rx=0 tx=0).stop 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/884916427 shutdown_connections 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/884916427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 0x7f7c24109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/884916427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24102d50 0x7f7c241031d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/884916427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24101b60 0x7f7c24101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/884916427 >> 172.21.15.18:0/884916427 conn(0x7f7c240fd2e0 msgr2=0x7f7c240ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/884916427 shutdown_connections 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.819+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/884916427 wait complete. 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.820+0000 7f7c2b2f1640 1 Processor -- start 2024-09-19T08:52:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.820+0000 7f7c2b2f1640 1 -- start start 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.820+0000 7f7c2b2f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 0x7f7c24197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.820+0000 7f7c2b2f1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24102d50 0x7f7c24198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.820+0000 7f7c2b2f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 0x7f7c2419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2b2f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2410d690 con 0x7f7c24101b60 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2b2f1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2410d510 con 0x7f7c24102d50 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2b2f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2410d810 con 0x7f7c24103710 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 0x7f7c24197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2988e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 0x7f7c2419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 0x7f7c24197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41002/0 (socket says 172.21.15.18:41002) 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 -- 172.21.15.18:0/3591014942 learned_addr learned my addr 172.21.15.18:0/3591014942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2888c640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24102d50 0x7f7c24198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 -- 172.21.15.18:0/3591014942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 msgr2=0x7f7c2419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 0x7f7c2419f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 -- 172.21.15.18:0/3591014942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24102d50 msgr2=0x7f7c24198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24102d50 0x7f7c24198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.821+0000 7f7c2908d640 1 -- 172.21.15.18:0/3591014942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2419f940 con 0x7f7c24101b60 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c2988e640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 0x7f7c2419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c2888c640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24102d50 0x7f7c24198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 0x7f7c24197d30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000e9a0 tx=0x7f7c2000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c1a7fc640 1 -- 172.21.15.18:0/3591014942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000cd80 con 0x7f7c24101b60 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c1a7fc640 1 -- 172.21.15.18:0/3591014942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c200108e0 con 0x7f7c24101b60 2024-09-19T08:52:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2419fc30 con 0x7f7c24101b60 2024-09-19T08:52:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c1a7fc640 1 -- 172.21.15.18:0/3591014942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20018950 con 0x7f7c24101b60 2024-09-19T08:52:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.822+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241a01d0 con 0x7f7c24101b60 2024-09-19T08:52:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.825+0000 7f7c1a7fc640 1 -- 172.21.15.18:0/3591014942 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7c20018af0 con 0x7f7c24101b60 2024-09-19T08:52:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.829+0000 7f7c2e091740 1 Processor -- start 2024-09-19T08:52:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.829+0000 7f7c1a7fc640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c100a33f0 0x7f7c100a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c1a7fc640 1 -- 172.21.15.18:0/3591014942 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7c200d0190 con 0x7f7c24101b60 2024-09-19T08:52:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 -- start start 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9649a0 0x55752c964da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c969da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c96c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55752c8c82f0 con 0x55752c96a370 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55752c870270 con 0x55752c9652e0 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.830+0000 7f7c2e091740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55752c8c42b0 con 0x55752c9649a0 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c100a33f0 0x7f7c100a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c96c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c96c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41014/0 (socket says 172.21.15.18:41014) 2024-09-19T08:52:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 -- 172.21.15.18:0/2694464388 learned_addr learned my addr 172.21.15.18:0/2694464388 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 -- 172.21.15.18:0/2694464388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9649a0 msgr2=0x55752c964da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9649a0 0x55752c964da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 -- 172.21.15.18:0/2694464388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 msgr2=0x55752c969da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c969da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 -- 172.21.15.18:0/2694464388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752c86f340 con 0x55752c96a370 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c100a33f0 0x7f7c100a58b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00f480 tx=0x7f7c1c0117c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.831+0000 7f7c2988e640 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c96c830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00fd10 tx=0x7f7c1c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b6d0d32bb5b068 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.832+0000 7f7c0f7fe640 1 -- 172.21.15.18:0/2694464388 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c024070 con 0x55752c96a370 2024-09-19T08:52:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.832+0000 7f7c0f7fe640 1 -- 172.21.15.18:0/2694464388 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c1c00eca0 con 0x55752c96a370 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.832+0000 7f7c0f7fe640 1 -- 172.21.15.18:0/2694464388 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c028660 con 0x55752c96a370 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 -- 172.21.15.18:0/2694464388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 msgr2=0x55752c96c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c96c830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00fd10 tx=0x7f7c1c01d000 comp rx=0 tx=0).stop 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 -- 172.21.15.18:0/2694464388 shutdown_connections 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c96c830 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c969da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 --2- 172.21.15.18:0/2694464388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9649a0 0x55752c964da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 -- 172.21.15.18:0/2694464388 >> 172.21.15.18:0/2694464388 conn(0x55752c960010 msgr2=0x55752c960410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.833+0000 7f7c2e091740 1 -- 172.21.15.18:0/2694464388 shutdown_connections 2024-09-19T08:52:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.834+0000 7f7c2e091740 1 -- 172.21.15.18:0/2694464388 wait complete. 2024-09-19T08:52:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.834+0000 7f7c2e091740 1 -- start start 2024-09-19T08:52:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.834+0000 7f7c2e091740 1 Processor -- start 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 0x55752c96ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9652e0 0x55752c96f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c976140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2908d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 0x55752c96ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2908d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 0x55752c96ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:46692/0 (socket says 172.21.15.18:46692) 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2908d640 1 -- 172.21.15.18:0/3754973453 learned_addr learned my addr 172.21.15.18:0/3754973453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55752c96d280 con 0x55752c96a370 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55752c851290 con 0x55752c9649a0 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55752c96d400 con 0x55752c9652e0 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.835+0000 7f7c2e091740 10 client.0 _ll_register_callbacks cb 0x55752c882140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2988e640 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c976140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2908d640 1 -- 172.21.15.18:0/3754973453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9652e0 msgr2=0x55752c96f100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9652e0 0x55752c96f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2908d640 1 -- 172.21.15.18:0/3754973453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 msgr2=0x55752c976140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c976140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2908d640 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752c5db210 con 0x55752c9649a0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 0x55752c96ebc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009c310 tx=0x7f7c20097e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db353e199c4ae83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3754973453 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2009ca80 con 0x55752c9649a0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3754973453 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7c20010430 con 0x55752c9649a0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.836+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c1c00eca0 con 0x55752c9649a0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3754973453 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c2009c380 con 0x55752c9649a0 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 10 client.25319 fetch_fsmap learned FSMap version 21 2024-09-19T08:52:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55752c6a7620 con 0x55752c9649a0 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3754973453 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c1c00eca0 con 0x55752c9649a0 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3754973453 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c20098040 con 0x55752c9649a0 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 10 client.25319 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 10 client.25319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 20 client.25319 populate_metadata read hostname 'smithi018' 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c97a830 0x55752c97cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 4 client.25319 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.837+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55752c8d5a20 con 0x55752c97a830 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.838+0000 7f7c2888c640 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c97a830 0x55752c97cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.838+0000 7f7c2888c640 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c97a830 0x55752c97cc40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca194ead5e99b8a server_cookie=7ec9288015e140f1 in_seq=0 out_seq=0 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.838+0000 7f7c0cff9640 10 client.25319 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3754973453 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55752c8d5a20 con 0x55752c97a830 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c0cff9640 10 client.25319 handle_command_reply: tid=0 2024-09-19T08:52:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 client.25319 shutdown 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 msgr2=0x55752c96ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 0x55752c96ebc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009c310 tx=0x7f7c20097e70 comp rx=0 tx=0).stop 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 shutdown_connections 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c97a830 0x55752c97cc40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c96a370 0x55752c976140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c9652e0 0x55752c96f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c0cff9640 0 client.25319 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3754973453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9649a0 0x55752c96ebc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 >> 172.21.15.18:0/3754973453 conn(0x55752c960010 msgr2=0x55752c961820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 shutdown_connections 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 1 -- 172.21.15.18:0/3754973453 wait complete. 2024-09-19T08:52:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.839+0000 7f7c2e091740 20 client.25319 trim_cache size 0 max 16384 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.861+0000 7f7c2e091740 1 Processor -- start 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 -- start start 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c96f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c95f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 0x55752c976060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a6520 con 0x55752c9649a0 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a8da0 con 0x55752c9652e0 2024-09-19T08:52:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.862+0000 7f7c2e091740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a6b90 con 0x55752c96a370 2024-09-19T08:52:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.863+0000 7f7c2888c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c95f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2888c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c95f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:46708/0 (socket says 172.21.15.18:46708) 2024-09-19T08:52:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2888c640 1 -- 172.21.15.18:0/3121972267 learned_addr learned my addr 172.21.15.18:0/3121972267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c96f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2908d640 1 -- 172.21.15.18:0/3121972267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 msgr2=0x55752c976060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:52:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 0x55752c976060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2908d640 1 -- 172.21.15.18:0/3121972267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 msgr2=0x55752c95f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c95f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.864+0000 7f7c2908d640 1 -- 172.21.15.18:0/3121972267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752c9645e0 con 0x55752c9649a0 2024-09-19T08:52:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.866+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c96f190 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009c080 tx=0x7f7c20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6b151e2ec3758a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.868+0000 7f7c0effd640 1 -- 172.21.15.18:0/3121972267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2009a4c0 con 0x55752c9649a0 2024-09-19T08:52:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.868+0000 7f7c0effd640 1 -- 172.21.15.18:0/3121972267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c2009b5e0 con 0x55752c9649a0 2024-09-19T08:52:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.868+0000 7f7c0effd640 1 -- 172.21.15.18:0/3121972267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2009b7d0 con 0x55752c9649a0 2024-09-19T08:52:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.871+0000 7f7c2e091740 1 -- 172.21.15.18:0/3121972267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 msgr2=0x55752c96f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.871+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c96f190 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009c080 tx=0x7f7c20000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.872+0000 7f7c2e091740 1 -- 172.21.15.18:0/3121972267 shutdown_connections 2024-09-19T08:52:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.872+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 0x55752c976060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.872+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c95f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.872+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3121972267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c96f190 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.872+0000 7f7c2e091740 1 -- 172.21.15.18:0/3121972267 >> 172.21.15.18:0/3121972267 conn(0x55752c960010 msgr2=0x55752c960ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.873+0000 7f7c2e091740 1 -- 172.21.15.18:0/3121972267 shutdown_connections 2024-09-19T08:52:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.875+0000 7f7c2e091740 1 -- 172.21.15.18:0/3121972267 wait complete. 2024-09-19T08:52:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.875+0000 7f7c2e091740 1 -- start start 2024-09-19T08:52:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 Processor -- start 2024-09-19T08:52:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c973d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c974290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 0x55752c975230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a7260 con 0x55752c9649a0 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a86d0 con 0x55752c9652e0 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2e091740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a7930 con 0x55752c96a370 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2908d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c973d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.876+0000 7f7c2908d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c973d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41028/0 (socket says 172.21.15.18:41028) 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2908d640 1 -- 172.21.15.18:0/3942625809 learned_addr learned my addr 172.21.15.18:0/3942625809 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2e091740 10 client.0 _ll_register_callbacks cb 0x7f7c200046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2908d640 1 -- 172.21.15.18:0/3942625809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 msgr2=0x55752c975230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 0x55752c975230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2908d640 1 -- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 msgr2=0x55752c974290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:52:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c974290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.877+0000 7f7c2908d640 1 -- 172.21.15.18:0/3942625809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752c975840 con 0x55752c9649a0 2024-09-19T08:52:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.878+0000 7f7c2908d640 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c973d50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7c200bbfd0 tx=0x7f7c2009b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd30b1309ad5147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.878+0000 7f7c0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.879+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3942625809 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200a4ff0 con 0x55752c9649a0 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.879+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3942625809 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7c200b5170 con 0x55752c9649a0 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.879+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c2009b5e0 con 0x55752c9649a0 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.879+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3942625809 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c2009ca80 con 0x55752c9649a0 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.879+0000 7f7c2e091740 10 client.15699 fetch_fsmap learned FSMap version 21 2024-09-19T08:52:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.879+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55752c9e5520 con 0x55752c9649a0 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3942625809 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c2009b5e0 con 0x55752c9649a0 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3942625809 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c200a18c0 con 0x55752c9649a0 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2e091740 10 client.15699 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2e091740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2e091740 20 client.15699 populate_metadata read hostname 'smithi018' 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c9e5c40 0x55752c9e8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2e091740 4 client.15699 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55752c8cfd70 con 0x55752c9e5c40 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.880+0000 7f7c2888c640 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c9e5c40 0x55752c9e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.881+0000 7f7c2888c640 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c9e5c40 0x55752c9e8060 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702f377417081ed9 server_cookie=152d283a3aa3e7c9 in_seq=0 out_seq=0 2024-09-19T08:52:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.881+0000 7f7c0cff9640 10 client.15699 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c0cff9640 1 -- 172.21.15.18:0/3942625809 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55752c8cfd70 con 0x55752c9e5c40 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c0cff9640 10 client.15699 handle_command_reply: tid=0 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 client.15699 shutdown 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 msgr2=0x55752c973d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c973d50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7c200bbfd0 tx=0x7f7c2009b470 comp rx=0 tx=0).stop 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 shutdown_connections 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x55752c9e5c40 0x55752c9e8060 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752c96a370 0x55752c975230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55752c9652e0 0x55752c974290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 --2- 172.21.15.18:0/3942625809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55752c9649a0 0x55752c973d50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 >> 172.21.15.18:0/3942625809 conn(0x55752c960010 msgr2=0x55752c9614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c0cff9640 0 client.15699 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 shutdown_connections 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 1 -- 172.21.15.18:0/3942625809 wait complete. 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.896+0000 7f7c2e091740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:52:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:52:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:52:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c100a33f0 msgr2=0x7f7c100a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c100a33f0 0x7f7c100a58b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00f480 tx=0x7f7c1c0117c0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 msgr2=0x7f7c24197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 0x7f7c24197d30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000e9a0 tx=0x7f7c2000ee60 comp rx=0 tx=0).stop 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 shutdown_connections 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7c100a33f0 0x7f7c100a58b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c24103710 0x7f7c2419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c24102d50 0x7f7c24198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 --2- 172.21.15.18:0/3591014942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c24101b60 0x7f7c24197d30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 >> 172.21.15.18:0/3591014942 conn(0x7f7c240fd2e0 msgr2=0x7f7c240ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 shutdown_connections 2024-09-19T08:52:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:07.897+0000 7f7c2b2f1640 1 -- 172.21.15.18:0/3591014942 wait complete. 2024-09-19T08:52:09.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:09 smithi162 ceph-mon[34870]: pgmap v555: 129 pgs: 129 active+clean; 72 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.3 MiB/s wr, 560 op/s 2024-09-19T08:52:09.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:09 smithi018 ceph-mon[30956]: pgmap v555: 129 pgs: 129 active+clean; 72 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.3 MiB/s wr, 560 op/s 2024-09-19T08:52:09.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:09 smithi150 ceph-mon[34610]: pgmap v555: 129 pgs: 129 active+clean; 72 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.3 MiB/s wr, 560 op/s 2024-09-19T08:52:11.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:11 smithi162 ceph-mon[34870]: pgmap v556: 129 pgs: 129 active+clean; 74 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.6 MiB/s wr, 629 op/s 2024-09-19T08:52:11.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:11 smithi018 ceph-mon[30956]: pgmap v556: 129 pgs: 129 active+clean; 74 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.6 MiB/s wr, 629 op/s 2024-09-19T08:52:11.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:11 smithi150 ceph-mon[34610]: pgmap v556: 129 pgs: 129 active+clean; 74 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.6 MiB/s wr, 629 op/s 2024-09-19T08:52:13.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:13 smithi162 ceph-mon[34870]: pgmap v557: 129 pgs: 129 active+clean; 66 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.5 MiB/s wr, 617 op/s 2024-09-19T08:52:13.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:13 smithi018 ceph-mon[30956]: pgmap v557: 129 pgs: 129 active+clean; 66 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.5 MiB/s wr, 617 op/s 2024-09-19T08:52:13.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:13 smithi150 ceph-mon[34610]: pgmap v557: 129 pgs: 129 active+clean; 66 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.5 MiB/s wr, 617 op/s 2024-09-19T08:52:15.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:15 smithi162 ceph-mon[34870]: pgmap v558: 129 pgs: 129 active+clean; 70 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-19T08:52:15.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:15 smithi018 ceph-mon[30956]: pgmap v558: 129 pgs: 129 active+clean; 70 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-19T08:52:15.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:15 smithi150 ceph-mon[34610]: pgmap v558: 129 pgs: 129 active+clean; 70 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-19T08:52:17.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:17 smithi162 ceph-mon[34870]: pgmap v559: 129 pgs: 129 active+clean; 75 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 631 op/s 2024-09-19T08:52:17.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:17 smithi018 ceph-mon[30956]: pgmap v559: 129 pgs: 129 active+clean; 75 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 631 op/s 2024-09-19T08:52:17.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:17 smithi150 ceph-mon[34610]: pgmap v559: 129 pgs: 129 active+clean; 75 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 631 op/s 2024-09-19T08:52:19.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:19 smithi162 ceph-mon[34870]: pgmap v560: 129 pgs: 129 active+clean; 73 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 544 op/s 2024-09-19T08:52:19.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:19 smithi018 ceph-mon[30956]: pgmap v560: 129 pgs: 129 active+clean; 73 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 544 op/s 2024-09-19T08:52:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:19 smithi150 ceph-mon[34610]: pgmap v560: 129 pgs: 129 active+clean; 73 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 544 op/s 2024-09-19T08:52:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.048+0000 7f7bbd1ed640 1 -- 172.21.15.18:0/4127688359 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8031880 con 0x7f7bb8072fc0 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 -- 172.21.15.18:0/4127688359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb8072fc0 msgr2=0x7f7bb8073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 --2- 172.21.15.18:0/4127688359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb8072fc0 0x7f7bb8073440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009900 tx=0x7f7ba802a400 comp rx=0 tx=0).stop 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 -- 172.21.15.18:0/4127688359 shutdown_connections 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 --2- 172.21.15.18:0/4127688359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb807a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 --2- 172.21.15.18:0/4127688359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb8072fc0 0x7f7bb8073440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 --2- 172.21.15.18:0/4127688359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb81096e0 0x7f7bb8109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 -- 172.21.15.18:0/4127688359 >> 172.21.15.18:0/4127688359 conn(0x7f7bb806ece0 msgr2=0x7f7bb8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 -- 172.21.15.18:0/4127688359 shutdown_connections 2024-09-19T08:52:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.049+0000 7f7bc0453640 1 -- 172.21.15.18:0/4127688359 wait complete. 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 Processor -- start 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 -- start start 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb8072fc0 0x7f7bb81b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb81b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb81096e0 0x7f7bb81b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb807dd00 con 0x7f7bb8073980 2024-09-19T08:52:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb807db80 con 0x7f7bb81096e0 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bc0453640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb807de80 con 0x7f7bb8072fc0 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb81b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb81b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39276/0 (socket says 172.21.15.18:39276) 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/1999933522 learned_addr learned my addr 172.21.15.18:0/1999933522 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bbe9f0640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb81096e0 0x7f7bb81b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.050+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb8072fc0 0x7f7bb81b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe9f0640 1 -- 172.21.15.18:0/1999933522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb8072fc0 msgr2=0x7f7bb81b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe9f0640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb8072fc0 0x7f7bb81b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe9f0640 1 -- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 msgr2=0x7f7bb81b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe9f0640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb81b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe9f0640 1 -- 172.21.15.18:0/1999933522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb81b90e0 con 0x7f7bb81096e0 2024-09-19T08:52:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb81b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb8072fc0 0x7f7bb81b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bbe9f0640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb81096e0 0x7f7bb81b8a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000e970 tx=0x7f7bb000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7baf7fe640 1 -- 172.21.15.18:0/1999933522 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000ccc0 con 0x7f7bb81096e0 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb81b93d0 con 0x7f7bb81096e0 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb8074450 con 0x7f7bb81096e0 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7baf7fe640 1 -- 172.21.15.18:0/1999933522 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7bb0005020 con 0x7f7bb81096e0 2024-09-19T08:52:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.051+0000 7f7baf7fe640 1 -- 172.21.15.18:0/1999933522 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0004a00 con 0x7f7bb81096e0 2024-09-19T08:52:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.055+0000 7f7baf7fe640 1 -- 172.21.15.18:0/1999933522 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7bb0004ba0 con 0x7f7bb81096e0 2024-09-19T08:52:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.055+0000 7f7bc31e9740 1 Processor -- start 2024-09-19T08:52:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.055+0000 7f7bc31e9740 1 -- start start 2024-09-19T08:52:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x560173881da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560173882370 0x560173884830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601737e02f0 con 0x56017387d2e0 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560173788270 con 0x56017387c9a0 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5601737dc2b0 con 0x560173882370 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7baf7fe640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7ba40a33c0 0x7f7ba40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:47512/0 (socket says 172.21.15.18:47512) 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2909516963 learned_addr learned my addr 172.21.15.18:0/2909516963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560173882370 0x560173884830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbe9f0640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7ba40a33c0 0x7f7ba40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x560173881da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7baf7fe640 1 -- 172.21.15.18:0/1999933522 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7bb00cfc80 con 0x7f7bb81096e0 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.056+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2909516963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560173882370 msgr2=0x560173884830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560173882370 0x560173884830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2909516963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 msgr2=0x560173881da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x560173881da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2909516963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560173787340 con 0x56017387c9a0 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bbe9f0640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7ba40a33c0 0x7f7ba40a5880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00982d0 tx=0x7f7bb00bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cda0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80314e0 tx=0x7f7ba8005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce7b7bd3e012ab92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bacbfe640 1 -- 172.21.15.18:0/2909516963 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8035030 con 0x56017387c9a0 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bacbfe640 1 -- 172.21.15.18:0/2909516963 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ba8031a30 con 0x56017387c9a0 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.057+0000 7f7bacbfe640 1 -- 172.21.15.18:0/2909516963 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba803d7b0 con 0x56017387c9a0 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2909516963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 msgr2=0x56017387cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cda0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80314e0 tx=0x7f7ba8005bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2909516963 shutdown_connections 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560173882370 0x560173884830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x560173881da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2909516963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cda0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2909516963 >> 172.21.15.18:0/2909516963 conn(0x560173878010 msgr2=0x560173878410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2909516963 shutdown_connections 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.058+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2909516963 wait complete. 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 -- start start 2024-09-19T08:52:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 Processor -- start 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387c9a0 0x560173886b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x5601738870b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bbe1ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x5601738870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601738852e0 con 0x56017387c9a0 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560173769290 con 0x560173882370 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560173885460 con 0x56017387d2e0 2024-09-19T08:52:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bbe1ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x5601738870b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:36926/0 (socket says 172.21.15.18:36926) 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bbe1ef640 1 -- 172.21.15.18:0/4134871836 learned_addr learned my addr 172.21.15.18:0/4134871836 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.059+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387c9a0 0x560173886b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbe1ef640 1 -- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 msgr2=0x56017388e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bc31e9740 10 client.0 _ll_register_callbacks cb 0x56017379a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbe1ef640 1 -- 172.21.15.18:0/4134871836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387c9a0 msgr2=0x560173886b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387c9a0 0x560173886b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbe1ef640 1 -- 172.21.15.18:0/4134871836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601734f3210 con 0x56017387d2e0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ba8031a30 con 0x56017387d2e0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x5601738870b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4012720 tx=0x7f7bb4012be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=515d7decdc780791 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7ba1ffb640 10 client.25417 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:52:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/4134871836 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4003d80 con 0x56017387d2e0 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.060+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/4134871836 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7bb40108d0 con 0x56017387d2e0 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/4134871836 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7bb4010b30 con 0x56017387d2e0 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 10 client.25417 fetch_fsmap learned FSMap version 21 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=21}) -- 0x5601735bf620 con 0x56017387d2e0 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/4134871836 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7bb4019070 con 0x56017387d2e0 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 10 client.25417 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 10 client.25417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 20 client.25417 populate_metadata read hostname 'smithi018' 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173894b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 4 client.25417 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601737eda20 con 0x560173892680 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.061+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173894b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.062+0000 7f7ba1ffb640 10 client.25417 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.062+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173894b20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f74c82a4a2fc0280 server_cookie=f343d1f3860e168d in_seq=0 out_seq=0 2024-09-19T08:52:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.062+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/4134871836 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601737eda20 con 0x560173892680 2024-09-19T08:52:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.062+0000 7f7ba1ffb640 10 client.25417 handle_command_reply: tid=0 2024-09-19T08:52:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.062+0000 7f7bc31e9740 1 client.25417 shutdown 2024-09-19T08:52:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 msgr2=0x5601738870b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x5601738870b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4012720 tx=0x7f7bb4012be0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 shutdown_connections 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173894b20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7ba1ffb640 0 client.25417 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x5601738870b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/4134871836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387c9a0 0x560173886b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 >> 172.21.15.18:0/4134871836 conn(0x560173878010 msgr2=0x560173879820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 shutdown_connections 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 1 -- 172.21.15.18:0/4134871836 wait complete. 2024-09-19T08:52:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.063+0000 7f7bc31e9740 20 client.25417 trim_cache size 0 max 16384 2024-09-19T08:52:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 Processor -- start 2024-09-19T08:52:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 -- start start 2024-09-19T08:52:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x56017388e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560173882370 0x5601738770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c00dc20 con 0x560173882370 2024-09-19T08:52:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c0104a0 con 0x56017387c9a0 2024-09-19T08:52:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.087+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c00e290 con 0x56017387d2e0 2024-09-19T08:52:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.090+0000 7f7bbe1ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x56017388e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.090+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.090+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:47530/0 (socket says 172.21.15.18:47530) 2024-09-19T08:52:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.090+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2421492853 learned_addr learned my addr 172.21.15.18:0/2421492853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.090+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560173882370 0x5601738770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.092+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2421492853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 msgr2=0x56017388e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.092+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x56017388e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.093+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2421492853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560173882370 msgr2=0x5601738770b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.093+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560173882370 0x5601738770b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.093+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/2421492853 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017387d7c0 con 0x56017387c9a0 2024-09-19T08:52:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.093+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cd80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8005ec0 tx=0x7f7ba80037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd83e75747afc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.094+0000 7f7ba3fff640 1 -- 172.21.15.18:0/2421492853 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8035040 con 0x56017387c9a0 2024-09-19T08:52:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.094+0000 7f7ba3fff640 1 -- 172.21.15.18:0/2421492853 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ba8031630 con 0x56017387c9a0 2024-09-19T08:52:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.094+0000 7f7ba3fff640 1 -- 172.21.15.18:0/2421492853 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba803c440 con 0x56017387c9a0 2024-09-19T08:52:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.096+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2421492853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 msgr2=0x56017387cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.096+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cd80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8005ec0 tx=0x7f7ba80037f0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.097+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2421492853 shutdown_connections 2024-09-19T08:52:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.097+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560173882370 0x5601738770b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.097+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387d2e0 0x56017388e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.097+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/2421492853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56017387c9a0 0x56017387cd80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.097+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2421492853 >> 172.21.15.18:0/2421492853 conn(0x560173878010 msgr2=0x5601738769a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.098+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2421492853 shutdown_connections 2024-09-19T08:52:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.099+0000 7f7bc31e9740 1 -- 172.21.15.18:0/2421492853 wait complete. 2024-09-19T08:52:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.099+0000 7f7bc31e9740 1 -- start start 2024-09-19T08:52:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.099+0000 7f7bc31e9740 1 Processor -- start 2024-09-19T08:52:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.099+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 0x56017388b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.099+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x56017388bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bc31e9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c00e960 con 0x56017387d2e0 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c00fdd0 con 0x560173882370 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bc31e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c00f030 con 0x56017387c9a0 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bc31e9740 10 client.0 _ll_register_callbacks cb 0x7f7bb4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 0x56017388b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 0x56017388b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:36938/0 (socket says 172.21.15.18:36938) 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/107278415 learned_addr learned my addr 172.21.15.18:0/107278415 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 msgr2=0x56017388ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/107278415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 msgr2=0x56017388bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x56017388bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.100+0000 7f7bbd9ee640 1 -- 172.21.15.18:0/107278415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017388d2d0 con 0x56017387c9a0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.101+0000 7f7bbd9ee640 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 0x56017388b770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8003a30 tx=0x7f7ba8056040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8705ad3b6f4bdbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.101+0000 7f7ba1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.101+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/107278415 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8035030 con 0x56017387c9a0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.101+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/107278415 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7ba803d650 con 0x56017387c9a0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.101+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ba8031630 con 0x56017387c9a0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.101+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/107278415 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7ba803d850 con 0x56017387c9a0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 10 client.25423 fetch_fsmap learned FSMap version 21 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560173905c10 con 0x56017387c9a0 2024-09-19T08:52:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/107278415 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ba8031630 con 0x56017387c9a0 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/107278415 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7ba804a3f0 con 0x56017387c9a0 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 10 client.25423 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 10 client.25423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 20 client.25423 populate_metadata read hostname 'smithi018' 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173907fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 4 client.25423 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:52:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.102+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601737e7d70 con 0x560173892680 2024-09-19T08:52:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.103+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173907fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.103+0000 7f7ba1ffb640 10 client.25423 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.103+0000 7f7bbe1ef640 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173907fe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c303392f053d21e server_cookie=765f38ff71b2fa05 in_seq=0 out_seq=0 2024-09-19T08:52:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.116+0000 7f7ba1ffb640 1 -- 172.21.15.18:0/107278415 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601737e7d70 con 0x560173892680 2024-09-19T08:52:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.116+0000 7f7ba1ffb640 10 client.25423 handle_command_reply: tid=0 2024-09-19T08:52:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.116+0000 7f7bc31e9740 1 client.25423 shutdown 2024-09-19T08:52:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 msgr2=0x56017388b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 0x56017388b770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8003a30 tx=0x7f7ba8056040 comp rx=0 tx=0).stop 2024-09-19T08:52:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 shutdown_connections 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x560173892680 0x560173907fe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560173882370 0x56017388ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56017387d2e0 0x56017388bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 --2- 172.21.15.18:0/107278415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56017387c9a0 0x56017388b770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 >> 172.21.15.18:0/107278415 conn(0x560173878010 msgr2=0x5601738771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7ba1ffb640 0 client.25423 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 shutdown_connections 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 1 -- 172.21.15.18:0/107278415 wait complete. 2024-09-19T08:52:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.117+0000 7f7bc31e9740 20 client.25423 trim_cache size 0 max 16384 2024-09-19T08:52:21.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:52:21.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:52:21.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:52:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7ba40a33c0 msgr2=0x7f7ba40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7ba40a33c0 0x7f7ba40a5880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00982d0 tx=0x7f7bb00bc040 comp rx=0 tx=0).stop 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb81096e0 msgr2=0x7f7bb81b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb81096e0 0x7f7bb81b8a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000e970 tx=0x7f7bb000ee30 comp rx=0 tx=0).stop 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 shutdown_connections 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7ba40a33c0 0x7f7ba40a5880 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bb81096e0 0x7f7bb81b8a70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb8073980 0x7f7bb81b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 --2- 172.21.15.18:0/1999933522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb8072fc0 0x7f7bb81b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 >> 172.21.15.18:0/1999933522 conn(0x7f7bb806ece0 msgr2=0x7f7bb8078670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 shutdown_connections 2024-09-19T08:52:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:21.118+0000 7f7bc0453640 1 -- 172.21.15.18:0/1999933522 wait complete. 2024-09-19T08:52:21.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: pgmap v561: 129 pgs: 129 active+clean; 76 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.6 MiB/s wr, 600 op/s 2024-09-19T08:52:21.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:21.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:21.418 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:21 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:52:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: pgmap v561: 129 pgs: 129 active+clean; 76 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.6 MiB/s wr, 600 op/s 2024-09-19T08:52:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.445 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:21.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:21.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:52:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: pgmap v561: 129 pgs: 129 active+clean; 76 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.6 MiB/s wr, 600 op/s 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:21.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:21.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:21.567 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:21 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:52:22.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:22 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi150 to 176.0M 2024-09-19T08:52:22.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:22 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T08:52:22.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:22 smithi162 ceph-mon[34870]: Unable to set osd_memory_target on smithi150 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T08:52:22.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:22 smithi162 ceph-mon[34870]: Unable to set osd_memory_target on smithi162 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T08:52:22.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:22 smithi162 ceph-mon[34870]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T08:52:22.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:22 smithi162 ceph-mon[34870]: Unable to set osd_memory_target on smithi018 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T08:52:22.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:22 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi150 to 176.0M 2024-09-19T08:52:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:22 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T08:52:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:22 smithi018 ceph-mon[30956]: Unable to set osd_memory_target on smithi150 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T08:52:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:22 smithi018 ceph-mon[30956]: Unable to set osd_memory_target on smithi162 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T08:52:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:22 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T08:52:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:22 smithi018 ceph-mon[30956]: Unable to set osd_memory_target on smithi018 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T08:52:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:22 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi150 to 176.0M 2024-09-19T08:52:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:22 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T08:52:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:22 smithi150 ceph-mon[34610]: Unable to set osd_memory_target on smithi150 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T08:52:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:22 smithi150 ceph-mon[34610]: Unable to set osd_memory_target on smithi162 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T08:52:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:22 smithi150 ceph-mon[34610]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T08:52:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:22 smithi150 ceph-mon[34610]: Unable to set osd_memory_target on smithi018 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T08:52:23.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:23 smithi162 ceph-mon[34870]: pgmap v562: 129 pgs: 129 active+clean; 75 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.5 MiB/s wr, 573 op/s 2024-09-19T08:52:23.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:23 smithi018 ceph-mon[30956]: pgmap v562: 129 pgs: 129 active+clean; 75 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.5 MiB/s wr, 573 op/s 2024-09-19T08:52:23.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:23 smithi150 ceph-mon[34610]: pgmap v562: 129 pgs: 129 active+clean; 75 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.5 MiB/s wr, 573 op/s 2024-09-19T08:52:25.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:25 smithi162 ceph-mon[34870]: pgmap v563: 129 pgs: 129 active+clean; 76 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-09-19T08:52:25.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:25 smithi018 ceph-mon[30956]: pgmap v563: 129 pgs: 129 active+clean; 76 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-09-19T08:52:25.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:25 smithi150 ceph-mon[34610]: pgmap v563: 129 pgs: 129 active+clean; 76 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-09-19T08:52:27.002 INFO:tasks.workunit.client.0.smithi018.stdout:All 50000 operations completed A-OK! 2024-09-19T08:52:27.005 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:52:27.005 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:52:27.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:27 smithi162 ceph-mon[34870]: pgmap v564: 129 pgs: 129 active+clean; 64 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.7 MiB/s wr, 595 op/s 2024-09-19T08:52:27.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:27 smithi018 ceph-mon[30956]: pgmap v564: 129 pgs: 129 active+clean; 64 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.7 MiB/s wr, 595 op/s 2024-09-19T08:52:27.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:27 smithi150 ceph-mon[34610]: pgmap v564: 129 pgs: 129 active+clean; 64 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.7 MiB/s wr, 595 op/s 2024-09-19T08:52:29.366 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:29 smithi150 ceph-mon[34610]: pgmap v565: 129 pgs: 129 active+clean; 67 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 520 op/s 2024-09-19T08:52:29.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:29 smithi162 ceph-mon[34870]: pgmap v565: 129 pgs: 129 active+clean; 67 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 520 op/s 2024-09-19T08:52:29.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:29 smithi018 ceph-mon[30956]: pgmap v565: 129 pgs: 129 active+clean; 67 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 520 op/s 2024-09-19T08:52:31.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:31 smithi162 ceph-mon[34870]: pgmap v566: 129 pgs: 129 active+clean; 69 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.4 MiB/s wr, 529 op/s 2024-09-19T08:52:31.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:31 smithi018 ceph-mon[30956]: pgmap v566: 129 pgs: 129 active+clean; 69 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.4 MiB/s wr, 529 op/s 2024-09-19T08:52:31.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:31 smithi150 ceph-mon[34610]: pgmap v566: 129 pgs: 129 active+clean; 69 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.4 MiB/s wr, 529 op/s 2024-09-19T08:52:33.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:33 smithi162 ceph-mon[34870]: pgmap v567: 129 pgs: 129 active+clean; 73 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-09-19T08:52:33.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:33 smithi018 ceph-mon[30956]: pgmap v567: 129 pgs: 129 active+clean; 73 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-09-19T08:52:33.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:33 smithi150 ceph-mon[34610]: pgmap v567: 129 pgs: 129 active+clean; 73 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 -- 172.21.15.18:0/3847360548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 msgr2=0x7ff57410a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 --2- 172.21.15.18:0/3847360548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff57410a030 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009ca0 tx=0x7ff56c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 -- 172.21.15.18:0/3847360548 shutdown_connections 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 --2- 172.21.15.18:0/3847360548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff57410a030 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 --2- 172.21.15.18:0/3847360548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574102de0 0x7ff574103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 --2- 172.21.15.18:0/3847360548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5740ffe10 0x7ff574100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 -- 172.21.15.18:0/3847360548 >> 172.21.15.18:0/3847360548 conn(0x7ff5740fb930 msgr2=0x7ff5740fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 -- 172.21.15.18:0/3847360548 shutdown_connections 2024-09-19T08:52:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.252+0000 7ff578a5e640 1 -- 172.21.15.18:0/3847360548 wait complete. 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 Processor -- start 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 -- start start 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5740ffe10 0x7ff574102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff574102de0 0x7ff574100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff5741012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff57410d690 con 0x7ff5741037a0 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff57410d510 con 0x7ff574102de0 2024-09-19T08:52:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff578a5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff57410d810 con 0x7ff5740ffe10 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff572d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff5741012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff572d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff5741012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46106/0 (socket says 172.21.15.18:46106) 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff572d9d640 1 -- 172.21.15.18:0/1918830528 learned_addr learned my addr 172.21.15.18:0/1918830528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff571d9b640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff574102de0 0x7ff574100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.253+0000 7ff57259c640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5740ffe10 0x7ff574102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff572d9d640 1 -- 172.21.15.18:0/1918830528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5740ffe10 msgr2=0x7ff574102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff572d9d640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5740ffe10 0x7ff574102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff572d9d640 1 -- 172.21.15.18:0/1918830528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff574102de0 msgr2=0x7ff574100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff572d9d640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff574102de0 0x7ff574100d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff572d9d640 1 -- 172.21.15.18:0/1918830528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff574101b60 con 0x7ff5741037a0 2024-09-19T08:52:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff571d9b640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff574102de0 0x7ff574100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff572d9d640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff5741012d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff56c031970 tx=0x7ff56c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff5637fe640 1 -- 172.21.15.18:0/1918830528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c004040 con 0x7ff5741037a0 2024-09-19T08:52:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff5637fe640 1 -- 172.21.15.18:0/1918830528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff56c004690 con 0x7ff5741037a0 2024-09-19T08:52:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5741a1dd0 con 0x7ff5741037a0 2024-09-19T08:52:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff5637fe640 1 -- 172.21.15.18:0/1918830528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c030d80 con 0x7ff5741037a0 2024-09-19T08:52:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.254+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5741a2290 con 0x7ff5741037a0 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff5637fe640 1 -- 172.21.15.18:0/1918830528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff56c0041e0 con 0x7ff5741037a0 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 Processor -- start 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 -- start start 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e590da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 0x56349e595da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e596370 0x56349e598830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56349e4f42f0 con 0x56349e5909a0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56349e49c270 con 0x56349e5912e0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.257+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56349e4f02b0 con 0x56349e596370 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff571d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e590da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 0x56349e595da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 0x56349e595da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:44848/0 (socket says 172.21.15.18:44848) 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 -- 172.21.15.18:0/1066640107 learned_addr learned my addr 172.21.15.18:0/1066640107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff5637fe640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff55c0a3370 0x7ff55c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff571d9b640 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e596370 0x56349e598830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff5637fe640 1 -- 172.21.15.18:0/1918830528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff56c0f1280 con 0x7ff5741037a0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff572d9d640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff55c0a3370 0x7ff55c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 -- 172.21.15.18:0/1066640107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e596370 msgr2=0x56349e598830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e596370 0x56349e598830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 -- 172.21.15.18:0/1066640107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 msgr2=0x56349e590da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e590da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 -- 172.21.15.18:0/1066640107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349e49b340 con 0x56349e5912e0 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff571d9b640 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e590da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff57259c640 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 0x56349e595da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff564009ca0 tx=0x7ff564011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794ba5a3c5a29212 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff572d9d640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff55c0a3370 0x7ff55c0a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0b9ea0 tx=0x7ff56c02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff560ff9640 1 -- 172.21.15.18:0/1066640107 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564004220 con 0x56349e5912e0 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff560ff9640 1 -- 172.21.15.18:0/1066640107 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5640043c0 con 0x56349e5912e0 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.258+0000 7ff560ff9640 1 -- 172.21.15.18:0/1066640107 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640198b0 con 0x56349e5912e0 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 -- 172.21.15.18:0/1066640107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 msgr2=0x56349e595da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 0x56349e595da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff564009ca0 tx=0x7ff564011810 comp rx=0 tx=0).stop 2024-09-19T08:52:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 -- 172.21.15.18:0/1066640107 shutdown_connections 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e596370 0x56349e598830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5912e0 0x56349e595da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/1066640107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e590da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 -- 172.21.15.18:0/1066640107 >> 172.21.15.18:0/1066640107 conn(0x56349e58c010 msgr2=0x56349e58c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 -- 172.21.15.18:0/1066640107 shutdown_connections 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.259+0000 7ff57b7fc740 1 -- 172.21.15.18:0/1066640107 wait complete. 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 -- start start 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 Processor -- start 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5909a0 0x56349e59abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 0x56349e59b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e5a2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56349e599340 con 0x56349e5912e0 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56349e47d290 con 0x56349e596370 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56349e5994c0 con 0x56349e5909a0 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57b7fc740 10 client.0 _ll_register_callbacks cb 0x56349e4ae140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 0x56349e59b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 0x56349e59b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46132/0 (socket says 172.21.15.18:46132) 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff57259c640 1 -- 172.21.15.18:0/3063691358 learned_addr learned my addr 172.21.15.18:0/3063691358 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff571d9b640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e5a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff571d9b640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5909a0 0x56349e59abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff571d9b640 1 -- 172.21.15.18:0/3063691358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5909a0 msgr2=0x56349e59abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff571d9b640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5909a0 0x56349e59abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff571d9b640 1 -- 172.21.15.18:0/3063691358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 msgr2=0x56349e59b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.260+0000 7ff571d9b640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 0x56349e59b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff571d9b640 1 -- 172.21.15.18:0/3063691358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349e207210 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff57259c640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 0x56349e59b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff571d9b640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e5a2140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff568009710 tx=0x7ff568005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20d107cff36c1570 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff559ffb640 1 -- 172.21.15.18:0/3063691358 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5680150d0 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff559ffb640 1 -- 172.21.15.18:0/3063691358 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff568009040 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5640043c0 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff559ffb640 1 -- 172.21.15.18:0/3063691358 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff568015270 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff57b7fc740 10 client.25352 fetch_fsmap learned FSMap version 21 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56349e2d3620 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.261+0000 7ff559ffb640 1 -- 172.21.15.18:0/3063691358 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5640043c0 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff559ffb640 1 -- 172.21.15.18:0/3063691358 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff56800fbb0 con 0x56349e596370 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57b7fc740 10 client.25352 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:52:34.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57b7fc740 10 client.25352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57b7fc740 20 client.25352 populate_metadata read hostname 'smithi018' 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e5a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57b7fc740 4 client.25352 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56349e501a20 con 0x56349e5a68b0 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57259c640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e5a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff559ffb640 10 client.25352 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.262+0000 7ff57259c640 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e5a8d30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a09f3e29ead9e671 server_cookie=aae3f16b0a704669 in_seq=0 out_seq=0 2024-09-19T08:52:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff559ffb640 1 -- 172.21.15.18:0/3063691358 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56349e501a20 con 0x56349e5a68b0 2024-09-19T08:52:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff559ffb640 10 client.25352 handle_command_reply: tid=0 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 client.25352 shutdown 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 msgr2=0x56349e5a2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e5a2140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff568009710 tx=0x7ff568005f90 comp rx=0 tx=0).stop 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 shutdown_connections 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e5a8d30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff559ffb640 0 client.25352 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e5a2140 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5912e0 0x56349e59b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/3063691358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5909a0 0x56349e59abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 >> 172.21.15.18:0/3063691358 conn(0x56349e58c010 msgr2=0x56349e58d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 shutdown_connections 2024-09-19T08:52:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 1 -- 172.21.15.18:0/3063691358 wait complete. 2024-09-19T08:52:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.269+0000 7ff57b7fc740 20 client.25352 trim_cache size 0 max 16384 2024-09-19T08:52:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 Processor -- start 2024-09-19T08:52:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 -- start start 2024-09-19T08:52:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e599fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e5a2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e58ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741aa910 con 0x56349e5909a0 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741ad190 con 0x56349e596370 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741aaf80 con 0x56349e5912e0 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e599fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e599fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46138/0 (socket says 172.21.15.18:46138) 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 -- 172.21.15.18:0/2138064721 learned_addr learned my addr 172.21.15.18:0/2138064721 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff57259c640 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e5a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e58ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 -- 172.21.15.18:0/2138064721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 msgr2=0x56349e5a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e5a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 -- 172.21.15.18:0/2138064721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 msgr2=0x56349e58ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e58ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 -- 172.21.15.18:0/2138064721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349e59a510 con 0x56349e5909a0 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.284+0000 7ff571d9b640 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e599fd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff568001eb0 tx=0x7ff568005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2808237c3c836234 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff55bfff640 1 -- 172.21.15.18:0/2138064721 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5680150d0 con 0x56349e5909a0 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff55bfff640 1 -- 172.21.15.18:0/2138064721 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff568009be0 con 0x56349e5909a0 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff55bfff640 1 -- 172.21.15.18:0/2138064721 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56800f790 con 0x56349e5909a0 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 -- 172.21.15.18:0/2138064721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 msgr2=0x56349e599fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e599fd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff568001eb0 tx=0x7ff568005850 comp rx=0 tx=0).stop 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 -- 172.21.15.18:0/2138064721 shutdown_connections 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e596370 0x56349e58ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e5a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/2138064721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e5909a0 0x56349e599fd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 -- 172.21.15.18:0/2138064721 >> 172.21.15.18:0/2138064721 conn(0x56349e58c010 msgr2=0x56349e5998c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 -- 172.21.15.18:0/2138064721 shutdown_connections 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.285+0000 7ff57b7fc740 1 -- 172.21.15.18:0/2138064721 wait complete. 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 -- start start 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 Processor -- start 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5909a0 0x56349e59f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e59fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e596370 0x56349e5a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741ab650 con 0x56349e596370 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741acac0 con 0x56349e5909a0 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741abd20 con 0x56349e5912e0 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57b7fc740 10 client.0 _ll_register_callbacks cb 0x7ff568015640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff571d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5909a0 0x56349e59f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e59fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff571d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5909a0 0x56349e59f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:44862/0 (socket says 172.21.15.18:44862) 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff571d9b640 1 -- 172.21.15.18:0/4024015381 learned_addr learned my addr 172.21.15.18:0/4024015381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff571d9b640 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e596370 0x56349e5a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57259c640 1 -- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5909a0 msgr2=0x56349e59f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57259c640 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5909a0 0x56349e59f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57259c640 1 -- 172.21.15.18:0/4024015381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e596370 msgr2=0x56349e5a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57259c640 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e596370 0x56349e5a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.286+0000 7ff57259c640 1 -- 172.21.15.18:0/4024015381 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349e5a11c0 con 0x56349e5912e0 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57259c640 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e59fba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff564005890 tx=0x7ff564011dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbed31d4d313c83d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff559ffb640 1 -- 172.21.15.18:0/4024015381 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564032060 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff559ffb640 1 -- 172.21.15.18:0/4024015381 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff56401f040 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff568009be0 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff559ffb640 1 -- 172.21.15.18:0/4024015381 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff564039050 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 10 client.25441 fetch_fsmap learned FSMap version 21 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56349e5a2530 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff559ffb640 1 -- 172.21.15.18:0/4024015381 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff568009be0 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff559ffb640 1 -- 172.21.15.18:0/4024015381 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff56402c2d0 con 0x56349e5912e0 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 10 client.25441 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 10 client.25441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 20 client.25441 populate_metadata read hostname 'smithi018' 2024-09-19T08:52:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e613c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 4 client.25441 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:52:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.287+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 --> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56349e4fbd70 con 0x56349e5a68b0 2024-09-19T08:52:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.288+0000 7ff571d9b640 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e613c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.295+0000 7ff571d9b640 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e613c20 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ff78e658ba5f76 server_cookie=b8e768ccdd87fd1d in_seq=0 out_seq=0 2024-09-19T08:52:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:34.295+0000 7ff559ffb640 10 client.25441 ms_handle_connect on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:35.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:35 smithi162 ceph-mon[34870]: pgmap v568: 129 pgs: 129 active+clean; 70 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 353 op/s 2024-09-19T08:52:35.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:35 smithi018 ceph-mon[30956]: pgmap v568: 129 pgs: 129 active+clean; 70 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 353 op/s 2024-09-19T08:52:35.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:35 smithi150 ceph-mon[34610]: pgmap v568: 129 pgs: 129 active+clean; 70 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 353 op/s 2024-09-19T08:52:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff559ffb640 1 -- 172.21.15.18:0/4024015381 <== mds.0 v2:172.21.15.150:6838/3054116303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56349e4fbd70 con 0x56349e5a68b0 2024-09-19T08:52:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff559ffb640 10 client.25441 handle_command_reply: tid=0 2024-09-19T08:52:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 client.25441 shutdown 2024-09-19T08:52:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 msgr2=0x56349e59fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e59fba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff564005890 tx=0x7ff564011dc0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 shutdown_connections 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:6838/3054116303,v1:172.21.15.150:6839/3054116303] conn(0x56349e5a68b0 0x56349e613c20 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56349e596370 0x56349e5a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff559ffb640 0 client.25441 ms_handle_reset on v2:172.21.15.150:6838/3054116303 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56349e5912e0 0x56349e59fba0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 --2- 172.21.15.18:0/4024015381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56349e5909a0 0x56349e59f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 >> 172.21.15.18:0/4024015381 conn(0x56349e58c010 msgr2=0x56349e5998c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 shutdown_connections 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 1 -- 172.21.15.18:0/4024015381 wait complete. 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.845+0000 7ff57b7fc740 20 client.25441 trim_cache size 0 max 16384 2024-09-19T08:52:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T08:52:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T08:52:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T08:52:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T08:52:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff55c0a3370 msgr2=0x7ff55c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff55c0a3370 0x7ff55c0a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0b9ea0 tx=0x7ff56c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 msgr2=0x7ff5741012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff5741012d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff56c031970 tx=0x7ff56c003ba0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 shutdown_connections 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7ff55c0a3370 0x7ff55c0a5830 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5741037a0 0x7ff5741012d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff574102de0 0x7ff574100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 --2- 172.21.15.18:0/1918830528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5740ffe10 0x7ff574102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 >> 172.21.15.18:0/1918830528 conn(0x7ff5740fb930 msgr2=0x7ff5741060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 shutdown_connections 2024-09-19T08:52:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T08:52:35.846+0000 7ff578a5e640 1 -- 172.21.15.18:0/1918830528 wait complete. 2024-09-19T08:52:37.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:37 smithi162 ceph-mon[34870]: pgmap v569: 129 pgs: 129 active+clean; 67 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 572 op/s 2024-09-19T08:52:37.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:37 smithi018 ceph-mon[30956]: pgmap v569: 129 pgs: 129 active+clean; 67 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 572 op/s 2024-09-19T08:52:37.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:37 smithi150 ceph-mon[34610]: pgmap v569: 129 pgs: 129 active+clean; 67 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 572 op/s 2024-09-19T08:52:39.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:39 smithi162 ceph-mon[34870]: pgmap v570: 129 pgs: 129 active+clean; 56 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 567 op/s 2024-09-19T08:52:39.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:39 smithi018 ceph-mon[30956]: pgmap v570: 129 pgs: 129 active+clean; 56 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 567 op/s 2024-09-19T08:52:39.486 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-19T08:52:39.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T08:52:39.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:39 smithi150 ceph-mon[34610]: pgmap v570: 129 pgs: 129 active+clean; 56 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 567 op/s 2024-09-19T08:52:39.798 DEBUG:teuthology.parallel:result is None 2024-09-19T08:52:39.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T08:52:39.832 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T08:52:39.833 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T08:52:39.843 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:52:39.881 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T08:52:39.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:52:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.026+0000 7f6702af8640 1 -- 172.21.15.18:0/230401858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc101c20 msgr2=0x7f66fc1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.026+0000 7f6702af8640 1 --2- 172.21.15.18:0/230401858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc101c20 0x7f66fc1020a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009900 tx=0x7f66f002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- 172.21.15.18:0/230401858 shutdown_connections 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 --2- 172.21.15.18:0/230401858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66fc1025e0 0x7f66fc108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 --2- 172.21.15.18:0/230401858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc101c20 0x7f66fc1020a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 --2- 172.21.15.18:0/230401858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66fc100a30 0x7f66fc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- 172.21.15.18:0/230401858 >> 172.21.15.18:0/230401858 conn(0x7f66fc0fc1b0 msgr2=0x7f66fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- 172.21.15.18:0/230401858 shutdown_connections 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- 172.21.15.18:0/230401858 wait complete. 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 Processor -- start 2024-09-19T08:52:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- start start 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 0x7f66fc1049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66fc101c20 0x7f66fc103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66fc1025e0 0x7f66fc103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10c560 con 0x7f66fc100a30 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10c3e0 con 0x7f66fc101c20 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.027+0000 7f6702af8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10c6e0 con 0x7f66fc1025e0 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 0x7f66fc1049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 0x7f66fc1049c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53540/0 (socket says 172.21.15.18:53540) 2024-09-19T08:52:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 -- 172.21.15.18:0/843572328 learned_addr learned my addr 172.21.15.18:0/843572328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f66fbfff640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66fc101c20 0x7f66fc103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6701095640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66fc1025e0 0x7f66fc103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 -- 172.21.15.18:0/843572328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66fc1025e0 msgr2=0x7f66fc103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66fc1025e0 0x7f66fc103540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 -- 172.21.15.18:0/843572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66fc101c20 msgr2=0x7f66fc103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66fc101c20 0x7f66fc103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 -- 172.21.15.18:0/843572328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc103dd0 con 0x7f66fc100a30 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6700894640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 0x7f66fc1049c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e9c0 tx=0x7f66ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00cd80 con 0x7f66fc100a30 2024-09-19T08:52:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66ec0035f0 con 0x7f66fc100a30 2024-09-19T08:52:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc1a1ec0 con 0x7f66fc100a30 2024-09-19T08:52:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec010690 con 0x7f66fc100a30 2024-09-19T08:52:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.028+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc1a22c0 con 0x7f66fc100a30 2024-09-19T08:52:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.029+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc1a25b0 con 0x7f66fc100a30 2024-09-19T08:52:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.030+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f66ec0037a0 con 0x7f66fc100a30 2024-09-19T08:52:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.031+0000 7f66f9ffb640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f66e40a3250 0x7f66e40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.032+0000 7f66fbfff640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f66e40a3250 0x7f66e40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.032+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f66ec0d02b0 con 0x7f66fc100a30 2024-09-19T08:52:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.032+0000 7f66fbfff640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f66e40a3250 0x7f66e40a5710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f66f0006010 tx=0x7f66f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.037+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66ec09cc00 con 0x7f66fc100a30 2024-09-19T08:52:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.384+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66fc1a2e10 con 0x7f66fc100a30 2024-09-19T08:52:40.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.387+0000 7f66f9ffb640 1 -- 172.21.15.18:0/843572328 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24907 (secure 0 0 0) 0x7f66ec09c500 con 0x7f66fc100a30 2024-09-19T08:52:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:52:40.388 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":90,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:45:19.553242+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f66e40a3250 msgr2=0x7f66e40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f66e40a3250 0x7f66e40a5710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f66f0006010 tx=0x7f66f0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 msgr2=0x7f66fc1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 0x7f66fc1049c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e9c0 tx=0x7f66ec00ee80 comp rx=0 tx=0).stop 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 shutdown_connections 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f66e40a3250 0x7f66e40a5710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66fc1025e0 0x7f66fc103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66fc101c20 0x7f66fc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 --2- 172.21.15.18:0/843572328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66fc100a30 0x7f66fc1049c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.391+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 >> 172.21.15.18:0/843572328 conn(0x7f66fc0fc1b0 msgr2=0x7f66fc06a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.392+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 shutdown_connections 2024-09-19T08:52:40.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.392+0000 7f6702af8640 1 -- 172.21.15.18:0/843572328 wait complete. 2024-09-19T08:52:40.412 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:38:34.272105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:43:10.423611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:43:12.483763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T08:43:18.962195+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T08:52:40.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:52:40.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.607+0000 7f4660f18640 1 -- 172.21.15.18:0/1570275191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c101c00 msgr2=0x7f465c102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.607+0000 7f4660f18640 1 --2- 172.21.15.18:0/1570275191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c101c00 0x7f465c102080 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f464401a910 tx=0x7f464403b470 comp rx=0 tx=0).stop 2024-09-19T08:52:40.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.609+0000 7f4660f18640 1 -- 172.21.15.18:0/1570275191 shutdown_connections 2024-09-19T08:52:40.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.609+0000 7f4660f18640 1 --2- 172.21.15.18:0/1570275191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f465c1025c0 0x7f465c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.609+0000 7f4660f18640 1 --2- 172.21.15.18:0/1570275191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c101c00 0x7f465c102080 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.609+0000 7f4660f18640 1 --2- 172.21.15.18:0/1570275191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465c100a10 0x7f465c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.609+0000 7f4660f18640 1 -- 172.21.15.18:0/1570275191 >> 172.21.15.18:0/1570275191 conn(0x7f465c0fc190 msgr2=0x7f465c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.613+0000 7f4660f18640 1 -- 172.21.15.18:0/1570275191 shutdown_connections 2024-09-19T08:52:40.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.613+0000 7f4660f18640 1 -- 172.21.15.18:0/1570275191 wait complete. 2024-09-19T08:52:40.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.614+0000 7f4660f18640 1 Processor -- start 2024-09-19T08:52:40.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 -- start start 2024-09-19T08:52:40.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 0x7f465c107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465c101c00 0x7f465c1084e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f465c1025c0 0x7f465c10fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f465c071a90 con 0x7f465c100a10 2024-09-19T08:52:40.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f465c071910 con 0x7f465c1025c0 2024-09-19T08:52:40.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f4660f18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f465c071c10 con 0x7f465c101c00 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.615+0000 7f465a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 0x7f465c107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 0x7f465c107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53554/0 (socket says 172.21.15.18:53554) 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 -- 172.21.15.18:0/111557116 learned_addr learned my addr 172.21.15.18:0/111557116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 -- 172.21.15.18:0/111557116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465c101c00 msgr2=0x7f465c1084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465c101c00 0x7f465c1084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 -- 172.21.15.18:0/111557116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f465c1025c0 msgr2=0x7f465c10fc70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f465c1025c0 0x7f465c10fc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 -- 172.21.15.18:0/111557116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c1103a0 con 0x7f465c100a10 2024-09-19T08:52:40.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.616+0000 7f465a59c640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 0x7f465c107fa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f464c00b470 tx=0x7f464c00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.617+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c015020 con 0x7f465c100a10 2024-09-19T08:52:40.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.618+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f464c011d40 con 0x7f465c100a10 2024-09-19T08:52:40.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.618+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c00f340 con 0x7f465c100a10 2024-09-19T08:52:40.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.618+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c110630 con 0x7f465c100a10 2024-09-19T08:52:40.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.618+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c110b30 con 0x7f465c100a10 2024-09-19T08:52:40.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.621+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c111fd0 con 0x7f465c100a10 2024-09-19T08:52:40.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.623+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f464c018020 con 0x7f465c100a10 2024-09-19T08:52:40.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.624+0000 7f46537fe640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f46480a3460 0x7f46480a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.624+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f464c0cf7c0 con 0x7f465c100a10 2024-09-19T08:52:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.629+0000 7f4653fff640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f46480a3460 0x7f46480a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.632+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f464c01f020 con 0x7f465c100a10 2024-09-19T08:52:40.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.636+0000 7f4653fff640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f46480a3460 0x7f46480a5920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f464401a860 tx=0x7f4644000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.821+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f465c06ea50 con 0x7f465c100a10 2024-09-19T08:52:40.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.822+0000 7f46537fe640 1 -- 172.21.15.18:0/111557116 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f464c00d040 con 0x7f465c100a10 2024-09-19T08:52:40.822 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T08:52:40.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f46480a3460 msgr2=0x7f46480a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f46480a3460 0x7f46480a5920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f464401a860 tx=0x7f4644000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 msgr2=0x7f465c107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 0x7f465c107fa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f464c00b470 tx=0x7f464c00b930 comp rx=0 tx=0).stop 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 shutdown_connections 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f46480a3460 0x7f46480a5920 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f465c1025c0 0x7f465c10fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465c101c00 0x7f465c1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 --2- 172.21.15.18:0/111557116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c100a10 0x7f465c107fa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 >> 172.21.15.18:0/111557116 conn(0x7f465c0fc190 msgr2=0x7f465c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 shutdown_connections 2024-09-19T08:52:40.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.824+0000 7f4660f18640 1 -- 172.21.15.18:0/111557116 wait complete. 2024-09-19T08:52:40.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:52:40.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 -- 172.21.15.18:0/3691220762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4240104ee0 msgr2=0x7f42401072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 --2- 172.21.15.18:0/3691220762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4240104ee0 0x7f42401072d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4234009900 tx=0x7f423402a410 comp rx=0 tx=0).stop 2024-09-19T08:52:40.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 -- 172.21.15.18:0/3691220762 shutdown_connections 2024-09-19T08:52:40.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 --2- 172.21.15.18:0/3691220762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4240107810 0x7f4240109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 --2- 172.21.15.18:0/3691220762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4240104ee0 0x7f42401072d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 --2- 172.21.15.18:0/3691220762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42401025b0 0x7f42401049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 -- 172.21.15.18:0/3691220762 >> 172.21.15.18:0/3691220762 conn(0x7f42400fc1b0 msgr2=0x7f42400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 -- 172.21.15.18:0/3691220762 shutdown_connections 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.942+0000 7f424636d640 1 -- 172.21.15.18:0/3691220762 wait complete. 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 Processor -- start 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 -- start start 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 0x7f4240197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4240104ee0 0x7f4240198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4240107810 0x7f424019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f424010d670 con 0x7f42401025b0 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f424010d4f0 con 0x7f4240107810 2024-09-19T08:52:40.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f424636d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f424010d7f0 con 0x7f4240104ee0 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f423ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 0x7f4240197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f423ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 0x7f4240197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53560/0 (socket says 172.21.15.18:53560) 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.943+0000 7f423ffff640 1 -- 172.21.15.18:0/1401867488 learned_addr learned my addr 172.21.15.18:0/1401867488 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423f7fe640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4240104ee0 0x7f4240198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f424490a640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4240107810 0x7f424019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423ffff640 1 -- 172.21.15.18:0/1401867488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4240104ee0 msgr2=0x7f4240198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423ffff640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4240104ee0 0x7f4240198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423ffff640 1 -- 172.21.15.18:0/1401867488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4240107810 msgr2=0x7f424019f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423ffff640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4240107810 0x7f424019f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423ffff640 1 -- 172.21.15.18:0/1401867488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424019fa30 con 0x7f42401025b0 2024-09-19T08:52:40.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423ffff640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 0x7f4240197e10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f423000c920 tx=0x7f423000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230007c70 con 0x7f42401025b0 2024-09-19T08:52:40.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4230007e10 con 0x7f42401025b0 2024-09-19T08:52:40.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424019fd20 con 0x7f42401025b0 2024-09-19T08:52:40.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230018820 con 0x7f42401025b0 2024-09-19T08:52:40.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.944+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42401a0190 con 0x7f42401025b0 2024-09-19T08:52:40.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.945+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42400fdca0 con 0x7f42401025b0 2024-09-19T08:52:40.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.946+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f42300189c0 con 0x7f42401025b0 2024-09-19T08:52:40.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.947+0000 7f423d7fa640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42280a3250 0x7f42280a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.947+0000 7f423f7fe640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42280a3250 0x7f42280a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.947+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f42300cfe10 con 0x7f42401025b0 2024-09-19T08:52:40.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.948+0000 7f423f7fe640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42280a3250 0x7f42280a5710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4234000c00 tx=0x7f42340314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:40.951+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4230014030 con 0x7f42401025b0 2024-09-19T08:52:41.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.204+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4240062e90 con 0x7f42401025b0 2024-09-19T08:52:41.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.205+0000 7f423d7fa640 1 -- 172.21.15.18:0/1401867488 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f423009c760 con 0x7f42401025b0 2024-09-19T08:52:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-19T08:52:41.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42280a3250 msgr2=0x7f42280a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42280a3250 0x7f42280a5710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4234000c00 tx=0x7f42340314a0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 msgr2=0x7f4240197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 0x7f4240197e10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f423000c920 tx=0x7f423000cde0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 shutdown_connections 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42280a3250 0x7f42280a5710 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4240107810 0x7f424019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4240104ee0 0x7f4240198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 --2- 172.21.15.18:0/1401867488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42401025b0 0x7f4240197e10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 >> 172.21.15.18:0/1401867488 conn(0x7f42400fc1b0 msgr2=0x7f4240102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 shutdown_connections 2024-09-19T08:52:41.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.209+0000 7f424636d640 1 -- 172.21.15.18:0/1401867488 wait complete. 2024-09-19T08:52:41.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:52:41.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:41 smithi162 ceph-mon[34870]: pgmap v571: 129 pgs: 129 active+clean; 59 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 731 op/s 2024-09-19T08:52:41.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:41 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/843572328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:41.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:41 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/111557116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:52:41.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.439+0000 7fb312027640 1 -- 172.21.15.18:0/966727843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c10ae00 msgr2=0x7fb30c111690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.439+0000 7fb312027640 1 --2- 172.21.15.18:0/966727843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c10ae00 0x7fb30c111690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb304009ca0 tx=0x7fb30402a960 comp rx=0 tx=0).stop 2024-09-19T08:52:41.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:41 smithi018 ceph-mon[30956]: pgmap v571: 129 pgs: 129 active+clean; 59 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 731 op/s 2024-09-19T08:52:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/843572328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:41.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/111557116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:52:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.444+0000 7fb312027640 1 -- 172.21.15.18:0/966727843 shutdown_connections 2024-09-19T08:52:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.445+0000 7fb312027640 1 --2- 172.21.15.18:0/966727843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c10ae00 0x7fb30c111690 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.445+0000 7fb312027640 1 --2- 172.21.15.18:0/966727843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb30c10a440 0x7fb30c10a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.445+0000 7fb312027640 1 --2- 172.21.15.18:0/966727843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c073410 0x7fb30c073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.445+0000 7fb312027640 1 -- 172.21.15.18:0/966727843 >> 172.21.15.18:0/966727843 conn(0x7fb30c06eb50 msgr2=0x7fb30c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.447+0000 7fb312027640 1 -- 172.21.15.18:0/966727843 shutdown_connections 2024-09-19T08:52:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.449+0000 7fb312027640 1 -- 172.21.15.18:0/966727843 wait complete. 2024-09-19T08:52:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.450+0000 7fb312027640 1 Processor -- start 2024-09-19T08:52:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.450+0000 7fb312027640 1 -- start start 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.451+0000 7fb312027640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c073410 0x7fb30c19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.451+0000 7fb312027640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 0x7fb30c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.451+0000 7fb312027640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb30c10ae00 0x7fb30c1a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.451+0000 7fb312027640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c113ce0 con 0x7fb30c10a440 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.451+0000 7fb312027640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c113b60 con 0x7fb30c10ae00 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.451+0000 7fb312027640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c113e60 con 0x7fb30c073410 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.452+0000 7fb303fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 0x7fb30c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.452+0000 7fb303fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 0x7fb30c19e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53574/0 (socket says 172.21.15.18:53574) 2024-09-19T08:52:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.452+0000 7fb303fff640 1 -- 172.21.15.18:0/3664573456 learned_addr learned my addr 172.21.15.18:0/3664573456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb303fff640 1 -- 172.21.15.18:0/3664573456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c073410 msgr2=0x7fb30c19e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb303fff640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c073410 0x7fb30c19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb303fff640 1 -- 172.21.15.18:0/3664573456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb30c10ae00 msgr2=0x7fb30c1a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb303fff640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb30c10ae00 0x7fb30c1a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb303fff640 1 -- 172.21.15.18:0/3664573456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c1a5e30 con 0x7fb30c10a440 2024-09-19T08:52:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb303fff640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 0x7fb30c19e750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c970 tx=0x7fb2fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc004220 con 0x7fb30c10a440 2024-09-19T08:52:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb312027640 1 -- 172.21.15.18:0/3664573456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c1a6120 con 0x7fb30c10a440 2024-09-19T08:52:41.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2fc0043c0 con 0x7fb30c10a440 2024-09-19T08:52:41.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.453+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00f450 con 0x7fb30c10a440 2024-09-19T08:52:41.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.454+0000 7fb312027640 1 -- 172.21.15.18:0/3664573456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1a6740 con 0x7fb30c10a440 2024-09-19T08:52:41.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.456+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c062fb0 con 0x7fb30c10a440 2024-09-19T08:52:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.457+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb2fc0079b0 con 0x7fb30c10a440 2024-09-19T08:52:41.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.458+0000 7fb3097fa640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb2f80a7730 0x7fb2f80a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.458+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb2fc0cfa10 con 0x7fb30c10a440 2024-09-19T08:52:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.458+0000 7fb30b7fe640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb2f80a7730 0x7fb2f80a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.459+0000 7fb30b7fe640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb2f80a7730 0x7fb2f80a9bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40096f0 tx=0x7fb2f4006c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.463+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2fc014030 con 0x7fb30c10a440 2024-09-19T08:52:41.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:41 smithi150 ceph-mon[34610]: pgmap v571: 129 pgs: 129 active+clean; 59 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 731 op/s 2024-09-19T08:52:41.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:41 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/843572328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:41.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:41 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/111557116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:52:41.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.642+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb30c1a93f0 con 0x7fb30c10a440 2024-09-19T08:52:41.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.643+0000 7fb3097fa640 1 -- 172.21.15.18:0/3664573456 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fb2fc09c360 con 0x7fb30c10a440 2024-09-19T08:52:41.643 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-19T08:52:41.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb2f80a7730 msgr2=0x7fb2f80a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb2f80a7730 0x7fb2f80a9bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40096f0 tx=0x7fb2f4006c40 comp rx=0 tx=0).stop 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 msgr2=0x7fb30c19e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 0x7fb30c19e750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c970 tx=0x7fb2fc00ce30 comp rx=0 tx=0).stop 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 shutdown_connections 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb2f80a7730 0x7fb2f80a9bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb30c10ae00 0x7fb30c1a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c10a440 0x7fb30c19e750 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 --2- 172.21.15.18:0/3664573456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c073410 0x7fb30c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 >> 172.21.15.18:0/3664573456 conn(0x7fb30c06eb50 msgr2=0x7fb30c10d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 shutdown_connections 2024-09-19T08:52:41.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.645+0000 7fb3027fc640 1 -- 172.21.15.18:0/3664573456 wait complete. 2024-09-19T08:52:41.656 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T08:52:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 -- 172.21.15.18:0/2728875113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a20100a30 msgr2=0x7f1a20100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 --2- 172.21.15.18:0/2728875113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a20100a30 0x7f1a20100e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009900 tx=0x7f1a1c02a410 comp rx=0 tx=0).stop 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 -- 172.21.15.18:0/2728875113 shutdown_connections 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 --2- 172.21.15.18:0/2728875113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a201025e0 0x7f1a20108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 --2- 172.21.15.18:0/2728875113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a20101c20 0x7f1a201020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 --2- 172.21.15.18:0/2728875113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a20100a30 0x7f1a20100e30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 -- 172.21.15.18:0/2728875113 >> 172.21.15.18:0/2728875113 conn(0x7f1a200fc1b0 msgr2=0x7f1a200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 -- 172.21.15.18:0/2728875113 shutdown_connections 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.763+0000 7f1a28149640 1 -- 172.21.15.18:0/2728875113 wait complete. 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 Processor -- start 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 -- start start 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a20100a30 0x7f1a20197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20101c20 0x7f1a201983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 0x7f1a2019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2010c540 con 0x7f1a201025e0 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2010c3c0 con 0x7f1a20100a30 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a28149640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2010c6c0 con 0x7f1a20101c20 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 0x7f1a2019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 0x7f1a2019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53578/0 (socket says 172.21.15.18:53578) 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 -- 172.21.15.18:0/3648865606 learned_addr learned my addr 172.21.15.18:0/3648865606 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a25ee5640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a20100a30 0x7f1a20197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a256e4640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20101c20 0x7f1a201983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 -- 172.21.15.18:0/3648865606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20101c20 msgr2=0x7f1a201983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20101c20 0x7f1a201983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 -- 172.21.15.18:0/3648865606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a20100a30 msgr2=0x7f1a20197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a20100a30 0x7f1a20197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 -- 172.21.15.18:0/3648865606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2019fa80 con 0x7f1a201025e0 2024-09-19T08:52:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.764+0000 7f1a266e6640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 0x7f1a2019f410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800eaa0 tx=0x7f1a1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.765+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800cdb0 con 0x7f1a201025e0 2024-09-19T08:52:41.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.765+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2019fd70 con 0x7f1a201025e0 2024-09-19T08:52:41.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.765+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a18005020 con 0x7f1a201025e0 2024-09-19T08:52:41.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.765+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a180116d0 con 0x7f1a201025e0 2024-09-19T08:52:41.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.765+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201a0210 con 0x7f1a201025e0 2024-09-19T08:52:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.766+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a201a04a0 con 0x7f1a201025e0 2024-09-19T08:52:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.767+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1a180051d0 con 0x7f1a201025e0 2024-09-19T08:52:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.767+0000 7f1a16ffd640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f1a0c0a3250 0x7f1a0c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.768+0000 7f1a25ee5640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f1a0c0a3250 0x7f1a0c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.768+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1a180cfe50 con 0x7f1a201025e0 2024-09-19T08:52:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.768+0000 7f1a25ee5640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f1a0c0a3250 0x7f1a0c0a5710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.772+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a18016030 con 0x7f1a201025e0 2024-09-19T08:52:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.951+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1a201a0670 con 0x7f1a201025e0 2024-09-19T08:52:41.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.952+0000 7f1a16ffd640 1 -- 172.21.15.18:0/3648865606 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f1a1809c150 con 0x7f1a201025e0 2024-09-19T08:52:41.952 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-19T08:52:41.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f1a0c0a3250 msgr2=0x7f1a0c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f1a0c0a3250 0x7f1a0c0a5710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c0314a0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 msgr2=0x7f1a2019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 0x7f1a2019f410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800eaa0 tx=0x7f1a1800ef60 comp rx=0 tx=0).stop 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 shutdown_connections 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f1a0c0a3250 0x7f1a0c0a5710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201025e0 0x7f1a2019f410 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20101c20 0x7f1a201983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 --2- 172.21.15.18:0/3648865606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a20100a30 0x7f1a20197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 >> 172.21.15.18:0/3648865606 conn(0x7f1a200fc1b0 msgr2=0x7f1a200fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 shutdown_connections 2024-09-19T08:52:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:41.954+0000 7f1a28149640 1 -- 172.21.15.18:0/3648865606 wait complete. 2024-09-19T08:52:41.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T08:52:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.087+0000 7f2f0759e640 1 -- 172.21.15.18:0/3325608644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 msgr2=0x7f2f08076fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.087+0000 7f2f0759e640 1 --2- 172.21.15.18:0/3325608644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08076fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009900 tx=0x7f2ef802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.090+0000 7f2f0759e640 1 -- 172.21.15.18:0/3325608644 shutdown_connections 2024-09-19T08:52:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.090+0000 7f2f0759e640 1 --2- 172.21.15.18:0/3325608644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f08078790 0x7f2f08079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.090+0000 7f2f0759e640 1 --2- 172.21.15.18:0/3325608644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f08077df0 0x7f2f08078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.090+0000 7f2f0759e640 1 --2- 172.21.15.18:0/3325608644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08076fb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.090+0000 7f2f0759e640 1 -- 172.21.15.18:0/3325608644 >> 172.21.15.18:0/3325608644 conn(0x7f2f080ff2c0 msgr2=0x7f2f08101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.095+0000 7f2f0759e640 1 -- 172.21.15.18:0/3325608644 shutdown_connections 2024-09-19T08:52:42.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.098+0000 7f2f0759e640 1 -- 172.21.15.18:0/3325608644 wait complete. 2024-09-19T08:52:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.099+0000 7f2f0759e640 1 Processor -- start 2024-09-19T08:52:42.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.101+0000 7f2f0759e640 1 -- start start 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.101+0000 7f2f0759e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.101+0000 7f2f0759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f08077df0 0x7f2f08071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.101+0000 7f2f0759e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f08078790 0x7f2f081ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.101+0000 7f2f0759e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f08113b70 con 0x7f2f08077df0 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.102+0000 7f2f0759e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2f081139f0 con 0x7f2f08076bb0 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.102+0000 7f2f0759e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f08113cf0 con 0x7f2f08078790 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.102+0000 7f2f0659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08070c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.18:39138/0 (socket says 172.21.15.18:39138) 2024-09-19T08:52:42.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 -- 172.21.15.18:0/4078855235 learned_addr learned my addr 172.21.15.18:0/4078855235 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:52:42.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 -- 172.21.15.18:0/4078855235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f08078790 msgr2=0x7f2f081ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:42.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f08078790 0x7f2f081ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:42.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 -- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f08077df0 msgr2=0x7f2f08071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:42.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f08077df0 0x7f2f08071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:42.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.103+0000 7f2f0659c640 1 -- 172.21.15.18:0/4078855235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f081035b0 con 0x7f2f08076bb0 2024-09-19T08:52:42.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.105+0000 7f2f0659c640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08070c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80314e0 tx=0x7f2ef8003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.106+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef803f070 con 0x7f2f08076bb0 2024-09-19T08:52:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.106+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ef8003e40 con 0x7f2f08076bb0 2024-09-19T08:52:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.106+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8035030 con 0x7f2f08076bb0 2024-09-19T08:52:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.107+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f08103840 con 0x7f2f08076bb0 2024-09-19T08:52:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.107+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f08103d60 con 0x7f2f08076bb0 2024-09-19T08:52:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.109+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f08078250 con 0x7f2f08076bb0 2024-09-19T08:52:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.114+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2ef8042070 con 0x7f2f08076bb0 2024-09-19T08:52:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.115+0000 7f2ef77fe640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2ef00a3450 0x7f2ef00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.115+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2ef80f0970 con 0x7f2f08076bb0 2024-09-19T08:52:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.118+0000 7f2f05d9b640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2ef00a3450 0x7f2ef00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.119+0000 7f2f05d9b640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2ef00a3450 0x7f2ef00a5910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f08072130 tx=0x7f2efc006c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.119+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ef80bd400 con 0x7f2f08076bb0 2024-09-19T08:52:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.364+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f2f0802d950 con 0x7f2f08076bb0 2024-09-19T08:52:42.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.371+0000 7f2ef77fe640 1 -- 172.21.15.18:0/4078855235 <== mon.2 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742340 (secure 0 0 0) 0x7f2ef80bcd00 con 0x7f2f08076bb0 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 18, 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: "active_gid": 14150, 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: "active_name": "x", 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addrs": { 2024-09-19T08:52:42.382 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2747026181 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2747026181 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.383 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addr": "172.21.15.18:6801/2747026181", 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "active_change": "2024-09-19T08:36:17.763126+0000", 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "available": true, 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "standbys": [ 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 24106, 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "z", 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-19T08:52:42.384 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:52:42.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.386 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.388 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.390 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-19T08:52:42.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-19T08:52:42.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-19T08:52:42.403 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.409 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.411 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.412 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T08:52:42.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-19T08:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:52:42.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:52:42.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:52:42.418 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-19T08:52:42.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-19T08:52:42.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-19T08:52:42.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.423 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.431 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:52:42.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-19T08:52:42.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-19T08:52:42.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.436 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-19T08:52:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-19T08:52:42.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.444 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.445 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.446 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.447 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.448 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.449 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.452 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.457 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.461 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.464 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.466 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-19T08:52:42.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-19T08:52:42.469 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-19T08:52:42.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.471 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.474 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:52:42.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:52:42.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:52:42.477 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:52:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.488 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.492 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:52:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:52:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:52:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:52:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:52:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:52:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:52:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:52:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:52:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-19T08:52:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-19T08:52:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-19T08:52:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:52:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:52:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-19T08:52:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:52:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.613 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.615 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.616 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.621 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:52:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:52:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-19T08:52:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:52:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T08:52:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T08:52:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-19T08:52:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T08:52:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.706 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-19T08:52:42.711 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.717 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-19T08:52:42.721 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.725 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.728 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.729 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.732 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.734 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.736 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.738 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.739 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-19T08:52:42.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-19T08:52:42.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.747 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.750 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.753 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.757 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.758 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.761 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.764 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.765 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.767 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.768 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.775 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.777 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.778 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.779 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.782 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.783 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.785 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.788 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.789 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.793 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.795 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.804 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.808 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.810 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-19T08:52:42.816 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.817 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.820 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.821 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.824 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 24116, 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "y", 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-19T08:52:42.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.830 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.833 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-19T08:52:42.836 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.837 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-19T08:52:42.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.843 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:52:42.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:52:42.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:52:42.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:52:42.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:52:42.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.850 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.851 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.852 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.855 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.858 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-19T08:52:42.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:42.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-19T08:52:42.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:52:42.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:52:42.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.866 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.873 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.877 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.878 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.882 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.883 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.894 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.895 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.896 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.898 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.902 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:52:42.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.905 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.907 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.910 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.912 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.913 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.914 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.919 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.927 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.929 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.930 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.931 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.932 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:42.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-19T08:52:42.935 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.943 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.956 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.957 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.958 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.959 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.961 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.964 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.965 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.966 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.967 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.968 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.969 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.970 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:52:42.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:52:42.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:52:42.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:52:42.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:52:42.977 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:52:42.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:52:42.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:52:42.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-19T08:52:42.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-19T08:52:42.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-19T08:52:42.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-19T08:52:42.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.985 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.987 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.990 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.992 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.994 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.996 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-19T08:52:42.998 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T08:52:42.999 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.002 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.003 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.006 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.007 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:52:43.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.015 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.016 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.018 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-19T08:52:43.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-19T08:52:43.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-19T08:52:43.027 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.028 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.031 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.032 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-19T08:52:43.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-19T08:52:43.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T08:52:43.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-19T08:52:43.036 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.037 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.038 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.040 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.042 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.043 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.044 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.046 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.048 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.049 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.051 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.053 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.054 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.061 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-19T08:52:43.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-19T08:52:43.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.067 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:52:43.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.071 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.072 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.074 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:52:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-19T08:52:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-19T08:52:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T08:52:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-19T08:52:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T08:52:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.188 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.189 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.192 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:52:43.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:52:43.194 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.195 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.198 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.201 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.202 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.203 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.206 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.207 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.208 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.209 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.211 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.213 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.214 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.222 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.223 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-19T08:52:43.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-19T08:52:43.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-19T08:52:43.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T08:52:43.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-19T08:52:43.229 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-19T08:52:43.230 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-19T08:52:43.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.233 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.235 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.236 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-19T08:52:43.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-19T08:52:43.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.239 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.242 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.243 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.244 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.246 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.247 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.249 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.252 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.254 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.255 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.257 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.260 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.262 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.263 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "modules": [ 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard", 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "iostat", 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nfs", 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "restful" 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-19T08:52:43.268 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.270 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.272 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.274 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.276 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.278 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.279 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.282 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-19T08:52:43.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-19T08:52:43.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-19T08:52:43.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-19T08:52:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.287 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.288 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.289 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.292 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.293 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-19T08:52:43.298 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.300 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.302 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:52:43.304 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:52:43.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:52:43.306 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:52:43.307 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:52:43.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.310 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.311 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.312 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.313 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.315 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.321 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.328 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:52:43.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-19T08:52:43.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:52:43.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:52:43.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-19T08:52:43.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-19T08:52:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-19T08:52:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-19T08:52:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-19T08:52:43.337 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-19T08:52:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-19T08:52:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-19T08:52:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.348 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.350 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.351 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-19T08:52:43.352 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-19T08:52:43.353 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.354 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.355 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.358 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.360 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.361 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.362 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.365 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.367 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.369 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.372 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.373 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.374 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.375 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.376 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.382 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.384 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.385 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.387 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.389 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.392 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:52:43.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:52:43.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:52:43.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:52:43.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:52:43.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.403 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.411 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.413 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.416 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.419 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.422 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.424 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.425 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-19T08:52:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:52:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.436 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.437 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.441 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-19T08:52:43.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.445 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.452 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.461 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.462 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.463 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.465 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.468 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.473 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-19T08:52:43.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.482 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.485 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.488 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.489 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.493 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.497 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.498 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.500 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.502 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.505 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:52:43.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.513 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.516 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.521 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-19T08:52:43.523 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.524 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.533 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T08:52:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.539 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.540 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.542 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.543 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.544 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.551 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-19T08:52:43.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.556 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.559 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.563 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:52:43.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.568 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.570 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.571 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.581 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-19T08:52:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T08:52:43.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.598 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.607 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:52:43.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-19T08:52:43.618 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.619 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.621 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T08:52:43.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.633 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.636 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.637 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.639 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.640 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.644 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.645 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.646 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.647 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.652 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.653 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.661 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.664 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.665 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.666 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.668 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.678 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.685 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.689 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.691 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.692 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.695 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-19T08:52:43.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T08:52:43.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T08:52:43.701 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T08:52:43.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "services": { 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard": "https://172.21.15.18:8443/" 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "always_on_modules": { 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "octopus": [ 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T08:52:43.713 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pacific": [ 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T08:52:43.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "quincy": [ 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T08:52:43.715 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "reef": [ 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T08:52:43.716 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "squid": [ 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T08:52:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "last_failure_osd_epoch": 3, 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "active_clients": [ 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 208953823 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "libcephsqlite", 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2095521150 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T08:52:43.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4019822149 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T08:52:43.720 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2260954159 2024-09-19T08:52:43.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.721 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:43.721 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T08:52:43.721 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:52:43.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2ef00a3450 msgr2=0x7f2ef00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2ef00a3450 0x7f2ef00a5910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f08072130 tx=0x7f2efc006c40 comp rx=0 tx=0).stop 2024-09-19T08:52:43.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 msgr2=0x7f2f08070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08070c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80314e0 tx=0x7f2ef8003cd0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 shutdown_connections 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f2ef00a3450 0x7f2ef00a5910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f08078790 0x7f2f081ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f08077df0 0x7f2f08071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 --2- 172.21.15.18:0/4078855235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f08076bb0 0x7f2f08070c20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 >> 172.21.15.18:0/4078855235 conn(0x7f2f080ff2c0 msgr2=0x7f2f08100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 shutdown_connections 2024-09-19T08:52:43.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:52:42.377+0000 7f2f0759e640 1 -- 172.21.15.18:0/4078855235 wait complete. 2024-09-19T08:52:43.723 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1401867488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3664573456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3648865606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1401867488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3664573456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:42 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3648865606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:43 smithi150 ceph-mon[34610]: pgmap v572: 129 pgs: 129 active+clean; 53 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 849 op/s 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:43 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/4078855235' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1401867488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3664573456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.724 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:42 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3648865606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T08:52:43.725 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:43 smithi162 ceph-mon[34870]: pgmap v572: 129 pgs: 129 active+clean; 53 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 849 op/s 2024-09-19T08:52:43.725 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:43 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/4078855235' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:52:43.731 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T08:52:43.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T08:52:43.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:43 smithi018 ceph-mon[30956]: pgmap v572: 129 pgs: 129 active+clean; 53 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 849 op/s 2024-09-19T08:52:43.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:43 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4078855235' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:52:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:44.876 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:52:44.876 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:44.876 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 162, 2024-09-19T08:52:44.876 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 159, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 463584, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 96848, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.023274643, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.009791999, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.015820217, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 158, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.007122761, 2024-09-19T08:52:44.877 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000045080 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 463584, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 96848 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 5, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 122, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3104, 2024-09-19T08:52:44.878 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 100000, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.010964755, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.006557263, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003364685, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 121, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.011553933, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000095487 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:44.879 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 100000 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:44.880 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.000397936, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000326341, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:44.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:44.882 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:44.883 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:44.884 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 29, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:44.886 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 163, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 440705, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 163, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 163, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 440705, 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T08:52:44.887 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:44.888 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:44.888 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:44.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:44.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:44.888 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:52:45.415 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:45 smithi018 ceph-mon[30956]: pgmap v573: 129 pgs: 129 active+clean; 52 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 976 KiB/s wr, 827 op/s 2024-09-19T08:52:45.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:45 smithi162 ceph-mon[34870]: pgmap v573: 129 pgs: 129 active+clean; 52 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 976 KiB/s wr, 827 op/s 2024-09-19T08:52:45.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:45 smithi150 ceph-mon[34610]: pgmap v573: 129 pgs: 129 active+clean; 52 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 976 KiB/s wr, 827 op/s 2024-09-19T08:52:45.875 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-19T08:52:45.875 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T08:52:45.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T08:52:46.138 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:46.645 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:52:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T08:52:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001360947, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000280812, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 168, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 165, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 465216, 2024-09-19T08:52:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 100688, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.023277834, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.010590790, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.016105938, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 164, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.007086361, 2024-09-19T08:52:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000043209 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 465216, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 100688 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 5, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 126, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3104, 2024-09-19T08:52:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 100704, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.011085213, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.006592011, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003382731, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 125, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.009618846, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000076950 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 100704 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T08:52:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 29, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T08:52:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 169, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 441485, 2024-09-19T08:52:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 169, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 169, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 441485, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:46.658 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:52:47.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:47 smithi018 ceph-mon[30956]: pgmap v574: 129 pgs: 129 active+clean; 14 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 981 KiB/s wr, 914 op/s 2024-09-19T08:52:47.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:47 smithi162 ceph-mon[34870]: pgmap v574: 129 pgs: 129 active+clean; 14 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 981 KiB/s wr, 914 op/s 2024-09-19T08:52:47.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:47 smithi150 ceph-mon[34610]: pgmap v574: 129 pgs: 129 active+clean; 14 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 981 KiB/s wr, 914 op/s 2024-09-19T08:52:47.647 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T08:52:47.647 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T08:52:47.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T08:52:47.907 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001849912, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000329835, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 164, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 161, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 464128, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 98128, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.022976461, 2024-09-19T08:52:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.009656112, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.017076006, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 160, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.008576193, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000053601 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 464128, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 98128 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 5, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 123, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3104, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 100176, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.011514142, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.006961297, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003549198, 2024-09-19T08:52:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 122, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.009306849, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000076285 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 100176 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T08:52:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148984, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T08:52:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 165, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 440965, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 165, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 165, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 440965, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:48.409 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:52:49.306 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T08:52:49.306 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T08:52:49.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T08:52:49.332 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:49 smithi018 ceph-mon[30956]: pgmap v575: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 693 KiB/s wr, 671 op/s 2024-09-19T08:52:49.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:49 smithi162 ceph-mon[34870]: pgmap v575: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 693 KiB/s wr, 671 op/s 2024-09-19T08:52:49.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:49 smithi150 ceph-mon[34610]: pgmap v575: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 693 KiB/s wr, 671 op/s 2024-09-19T08:52:49.571 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001386477, 2024-09-19T08:52:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000219785, 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:52:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 5, 2024-09-19T08:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 128, 2024-09-19T08:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3104, 2024-09-19T08:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 101056, 2024-09-19T08:52:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.011680245, 2024-09-19T08:52:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.007304463, 2024-09-19T08:52:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003234701, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 127, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.009928175, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000078174 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 101056 2024-09-19T08:52:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 170, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 167, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 465760, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 101968, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.023419955, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.011029030, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.015994026, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 166, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.006895881, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000041541 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 465760, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 101968 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T08:52:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T08:52:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 149007, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T08:52:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T08:52:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 171, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 441745, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 171, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 171, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 441745, 2024-09-19T08:52:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T08:52:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T08:52:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T08:52:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T08:52:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T08:52:50.123 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T08:52:50.821 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T08:52:50.821 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T08:52:50.821 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T08:52:51.079 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:52:51.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:51 smithi162 ceph-mon[34870]: pgmap v576: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 504 KiB/s wr, 539 op/s 2024-09-19T08:52:51.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:51 smithi018 ceph-mon[30956]: pgmap v576: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 504 KiB/s wr, 539 op/s 2024-09-19T08:52:51.468 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:51 smithi150 ceph-mon[34610]: pgmap v576: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 504 KiB/s wr, 539 op/s 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 43337, 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 43337, 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 11293674, 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 73066291, 2024-09-19T08:52:51.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 11, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 4, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 2.674435030, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.781631097, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.673192785, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 1.033204243, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 43336, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 10.101077539, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000233087 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-09-19T08:52:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000148, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000074 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 31362, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 31353, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 9408648, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 62369693, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 70, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 9, 2024-09-19T08:52:51.578 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 2.042936839, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.653477691, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.492361527, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.769826618, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 31352, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 7.048377017, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000224814 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 64, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000005538, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000086 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 495760, 2024-09-19T08:52:51.579 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 105360 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 84828, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 128569, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 28005747, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 61544507, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 13, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 5, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 5.238570036, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 2.023891354, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 3.000869656, 2024-09-19T08:52:51.580 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.578066983, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 128567, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 12.591551428, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000097937 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 156131, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.027334521, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000175 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.581 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 53568, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 328592 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 1, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-MDSRank": { 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 91698, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 28.952190636, 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000315734 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-PurgeQueue": { 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 10060, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 2.299011463, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000228529 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "request": 27112, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "reply": 27112, 2024-09-19T08:52:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: "reply_latency": { 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 27112, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 68.443533356, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002524473 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_reply": 0, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "forward": 0, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_complete": 0, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_keys": 0, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_commit": 1075, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_split": 22, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_merge": 0, 2024-09-19T08:52:51.584 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes": 871, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_top": 4, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_bottom": 867, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pin_tail": 0, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pinned": 864, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_expired": 0, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_with_caps": 5, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": 5, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "subtrees": 2, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse": 31054, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_hit": 28605, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_forward": 0, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_discover": 0, 2024-09-19T08:52:51.585 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_remote_ino": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_lock": 3, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "load_cent": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "q": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "exported": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "exported_inodes": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "imported": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "imported_inodes": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_dir_fetch": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_peer_discover": 0, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rfiles": 4, 2024-09-19T08:52:51.586 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rbytes": 234, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rsnaps": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_set_tag": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_file_inodes": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_revoke": 10246, 2024-09-19T08:52:51.587 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_grant": 23751, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_trunc": 7984, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps": 36817, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps_dirty": 15412, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_cap_release": 42, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "process_request_cap_release": 31069 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_cache": { 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update": 0, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update_receipt": 0, 2024-09-19T08:52:51.588 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_try_discover": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_send_discover": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_handle_discover": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_delayed": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_created": 7279, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_enqueued": 7276, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_reintegrated": 3, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_migrated": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_processing": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_started": 0, 2024-09-19T08:52:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_completed": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_exportdir": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_flush": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragmentdir": 22, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragstats": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_inodestats": 0 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_log": { 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "evlrg": 0, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "evadd": 63555, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "evex": 59238, 2024-09-19T08:52:51.590 INFO:teuthology.orchestra.run.smithi150.stdout: "evtrm": 59238, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "ev": 4317, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "evexg": 0, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "evexd": 5368, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "segadd": 97, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "segex": 91, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "segtrm": 91, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "seg": 6, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "segmjr": 1, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "segexg": 0, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "segexd": 8, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "expos": 116396120, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "wrpos": 123128671, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "rdpos": 0, 2024-09-19T08:52:51.591 INFO:teuthology.orchestra.run.smithi150.stdout: "jlat": { 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 25257, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 56.117338014, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002221852 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "replayed": 0 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_mem": { 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "ino": 23, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "ino+": 7299, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "ino-": 7276, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "dir": 18, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "dir+": 261, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "dir-": 243, 2024-09-19T08:52:51.592 INFO:teuthology.orchestra.run.smithi150.stdout: "dn": 870, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "dn+": 12223, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "dn-": 11353, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "cap": 5, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "cap+": 7293, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "cap-": 7288, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "rss": 115632, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "heap": 231712 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_server": { 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_client_request": 46075, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_server_request": 0, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_request": 27112, 2024-09-19T08:52:51.593 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_session": 19, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_peer_request": 0, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "req_create_latency": { 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 7207, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 20.731663032, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002876600 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getattr_latency": { 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1596, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.433168104, 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000271408 2024-09-19T08:52:51.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getfilelock_latency": { 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "req_link_latency": { 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.004905768, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001635256 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookup_latency": { 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1210, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.312923730, 2024-09-19T08:52:51.595 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000258614 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookuphash_latency": { 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupino_latency": { 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupname_latency": { 2024-09-19T08:52:51.596 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupparent_latency": { 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupsnap_latency": { 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lssnap_latency": { 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mkdir_latency": { 2024-09-19T08:52:51.598 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 73, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.070403660, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000964433 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mknod_latency": { 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mksnap_latency": { 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "req_open_latency": { 2024-09-19T08:52:51.599 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 182, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.130105416, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000714864 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "req_readdir_latency": { 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 500, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.986103575, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001972207 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rename_latency": { 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 94, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.183279898, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001949786 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.600 INFO:teuthology.orchestra.run.smithi150.stdout: "req_renamesnap_latency": { 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "req_snapdiff_latency": { 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmdir_latency": { 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 73, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 2.429798473, 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.033284910 2024-09-19T08:52:51.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmsnap_latency": { 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmxattr_latency": { 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setattr_latency": { 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 9001, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 32.673834218, 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.003630022 2024-09-19T08:52:51.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setdirlayout_latency": { 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setfilelock_latency": { 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 8, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.003734560, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000466820 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setlayout_latency": { 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setxattr_latency": { 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 8, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.020975819, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002621977 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "req_symlink_latency": { 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 6, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.006463214, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001077202 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "req_unlink_latency": { 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 7151, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 10.456173889, 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001462197 2024-09-19T08:52:51.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getvxattr_latency": { 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_sessions": { 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "session_count": 1, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "session_add": 3, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "session_remove": 2, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_open": 1, 2024-09-19T08:52:51.605 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_stale": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "total_load": 6951, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "average_load": 6951, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "avg_session_uptime": 444, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "mdthresh_evicted": 0 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:51.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:51.607 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-19T08:52:51.608 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 303201, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 118, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:51.609 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 9048, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 170, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 720969, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 7472, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.610 INFO:teuthology.orchestra.run.smithi150.stdout: "objecter": { 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_active": 0, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_laggy": 0, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send": 94722, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send_bytes": 133639505, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_resend": 32, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_reply": 94722, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_latency": { 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 94722, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 4595.003366247, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.048510413 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "op_inflight": 0, 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "oplen_avg": { 2024-09-19T08:52:51.611 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 94722, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 119887 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "op": 94722, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "op_r": 95, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "op_w": 94627, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "op_rmw": 0, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "op_pg": 0, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_stat": 820, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_create": 14837, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_read": 95, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_write": 25352, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writefull": 161, 2024-09-19T08:52:51.612 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writesame": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_append": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_zero": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_truncate": 6, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_delete": 15251, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_mapext": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_sparse_read": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_clonerange": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_getxattr": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_setxattr": 23030, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_rmxattr": 0, 2024-09-19T08:52:51.613 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_call": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_watch": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_notify": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_other": 37742, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_active": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_send": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_resend": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_ping": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_active": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_send": 0, 2024-09-19T08:52:51.614 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_resend": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_active": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_send": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_resend": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_active": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_send": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_resend": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "command_active": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "command_send": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "command_resend": 0, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "map_epoch": 90, 2024-09-19T08:52:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: "map_full": 0, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "map_inc": 10, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_sessions": 12, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_open": 12, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_close": 0, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_laggy": 0, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_wr": 2340, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_rd": 0, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_del": 253 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "oft": { 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_objs": 1, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_updates": 0, 2024-09-19T08:52:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_removes": 0 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "osd-slow-ops": { 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_ops_count": 0 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "purge_queue": { 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops": 0, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops_high_water": 111, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing": 0, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_high_water": 28, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed_ops": 14669, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed": 7276, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_item_in_journal": 0 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.617 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 159523, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 34331341, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 159523, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 159523, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 34331341, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.618 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_bytes": { 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 94722, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 134432053, 2024-09-19T08:52:51.619 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 94722, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 134432053, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_ops": { 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1024, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-19T08:52:51.620 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 94722, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 94722, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 94722, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 94722, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:51.621 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 7276, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 792548, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 7276, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 95, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 792548, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle-0x55db7bf3a960": { 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 63555, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 118934367, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 63555, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 25257, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 118934367, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:51.623 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:51.624 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:51.624 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.624 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:51.624 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-19T08:52:52.394 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=22 2024-09-19T08:52:52.394 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T08:52:52.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T08:52:52.656 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:52:53.138 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 4, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 4, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 2944, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 448, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.003024417, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000053915, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.002109585, 2024-09-19T08:52:53.139 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.003931032, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001310344 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:52:53.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 169, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 166, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 465488, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 101328, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.022585395, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.009803089, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.016541407, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 165, 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.009646855, 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000058465 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:53.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 465488, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 101328 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 125, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 160, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 100432, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.006818343, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.004845978, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000693860, 2024-09-19T08:52:53.143 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 123, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.006657553, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000054126 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 100432 2024-09-19T08:52:53.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:53.145 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:53.146 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:53.146 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:53.146 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:53.146 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:53.146 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:53.146 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:53.147 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:53.148 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-19T08:52:53.149 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:53.149 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:53.149 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:53.149 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:53.149 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:52:53.150 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 29, 2024-09-19T08:52:53.150 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:53.150 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:53.150 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-19T08:52:53.150 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-19T08:52:53.150 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:53.151 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:53.151 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:53.151 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:53.151 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:53.151 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2024-09-19T08:52:53.152 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:53.153 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 170, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 441615, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 170, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 170, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 441615, 2024-09-19T08:52:53.154 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:53.155 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:53.155 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:53.155 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:53.155 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:53.155 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-19T08:52:53.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:53 smithi150 ceph-mon[34610]: pgmap v577: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 162 KiB/s wr, 317 op/s 2024-09-19T08:52:53.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:53 smithi162 ceph-mon[34870]: pgmap v577: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 162 KiB/s wr, 317 op/s 2024-09-19T08:52:53.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:53 smithi018 ceph-mon[30956]: pgmap v577: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 162 KiB/s wr, 317 op/s 2024-09-19T08:52:53.845 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-19T08:52:53.845 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T08:52:53.845 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T08:52:54.093 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:52:54.596 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-19T08:52:54.596 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 4, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 4, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 2944, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 448, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.003147862, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000043644, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.002197441, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:54.597 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.004011521, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001337173 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T08:52:54.598 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 167, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 164, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 464944, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 100048, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.022611036, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.009809743, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.017428657, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:54.599 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 163, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.010610526, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000065095 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 464944, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 100048 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.600 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 124, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 160, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 100256, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.006876811, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.004937768, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000774535, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 122, 2024-09-19T08:52:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.006788584, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000055644 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 100256 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-19T08:52:54.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-19T08:52:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:54.603 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:54.604 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:54.605 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 149007, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 30, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-19T08:52:54.606 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2024-09-19T08:52:54.607 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:54.608 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-19T08:52:54.609 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:54.609 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 168, 2024-09-19T08:52:54.609 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 441355, 2024-09-19T08:52:54.609 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:54.609 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 168, 2024-09-19T08:52:54.613 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-19T08:52:54.613 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-19T08:52:54.613 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 168, 2024-09-19T08:52:54.613 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 441355, 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:54.614 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-19T08:52:55.288 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-09-19T08:52:55.289 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T08:52:55.289 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T08:52:55.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:55 smithi162 ceph-mon[34870]: pgmap v578: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 132 op/s 2024-09-19T08:52:55.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:55 smithi018 ceph-mon[30956]: pgmap v578: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 132 op/s 2024-09-19T08:52:55.537 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:52:55.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:55 smithi150 ceph-mon[34610]: pgmap v578: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 132 op/s 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 172, 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 169, 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 466304, 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 103248, 2024-09-19T08:52:56.047 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.023198466, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.009688767, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.016956881, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 168, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.008450298, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000050299 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:56.048 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 466304, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 103248 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 5, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 130, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 3104, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 101408, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:56.049 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.008703251, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.004983919, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.002599642, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 129, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.009093625, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000070493 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:56.050 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 101408 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 0, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 2, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 0, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.000322450, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:52:56.051 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000258491, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:52:56.052 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:56.053 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:56.054 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:56.055 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 148985, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 30, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-19T08:52:56.056 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:56.057 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 173, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 442005, 2024-09-19T08:52:56.058 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 173, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 173, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 442005, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:56.059 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-19T08:52:56.060 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-19T08:52:56.898 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-19T08:52:56.898 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T08:52:56.899 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T08:52:57.159 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:52:57.280 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:57 smithi162 ceph-mon[34870]: pgmap v579: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 116 op/s 2024-09-19T08:52:57.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:57 smithi018 ceph-mon[30956]: pgmap v579: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 116 op/s 2024-09-19T08:52:57.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:57 smithi150 ceph-mon[34610]: pgmap v579: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 116 op/s 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 169, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 166, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 465488, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 101328, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.022762398, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.009945882, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.015136949, 2024-09-19T08:52:58.023 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 165, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.008804081, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000053358 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 465488, 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 101328 2024-09-19T08:52:58.024 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 125, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 100432, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.007344073, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.005280147, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000768227, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:58.025 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 123, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.006625443, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000053865 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 100432 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4, 2024-09-19T08:52:58.026 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2944, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 448, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.002319809, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000040992, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002281847, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.004001231, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001333743 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.027 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T08:52:58.028 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:52:58.029 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:52:58.030 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148984, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 30, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T08:52:58.031 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T08:52:58.032 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 170, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 441615, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 170, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T08:52:58.033 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 170, 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 441615, 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:52:58.034 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T08:52:59.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:52:59 smithi162 ceph-mon[34870]: pgmap v580: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 9 op/s 2024-09-19T08:52:59.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:52:59 smithi018 ceph-mon[30956]: pgmap v580: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 9 op/s 2024-09-19T08:52:59.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:52:59 smithi150 ceph-mon[34610]: pgmap v580: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 9 op/s 2024-09-19T08:52:59.939 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-19T08:52:59.940 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T08:52:59.940 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T08:53:00.197 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:53:00.699 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T08:53:00.699 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:53:00.699 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 174, 2024-09-19T08:53:00.699 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 169, 2024-09-19T08:53:00.699 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 468704, 2024-09-19T08:53:00.699 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 102416, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.026496889, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.010502098, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.019358396, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 169, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.012491406, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000073913 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:00.700 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 468704, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 102416 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 126, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 100608, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-19T08:53:00.701 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.007163667, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.004922848, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000973199, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 124, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.006747881, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000054418 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:00.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 100608 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.000261694, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:53:00.703 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000172323, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:53:00.704 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:53:00.705 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:53:00.706 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:53:00.707 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:53:00.708 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 29, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T08:53:00.709 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 171, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 441745, 2024-09-19T08:53:00.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 171, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 171, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 441745, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:00.711 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T08:53:01.362 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:01 smithi162 ceph-mon[34870]: pgmap v581: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:53:01.392 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-19T08:53:01.917 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T08:53:01.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T08:53:01.919 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:01 smithi150 ceph-mon[34610]: pgmap v581: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:53:01.919 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:01 smithi018 ceph-mon[30956]: pgmap v581: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T08:53:02.179 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1299, 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1295, 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 38563749, 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 458870, 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 7, 2024-09-19T08:53:02.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.140598923, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.040840016, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.063305346, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.031691397, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1294, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.046221856, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000035720 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 481200, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 103024 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 462, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 584, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 47760592, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 433312, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-19T08:53:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.061145207, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.014585169, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.033336991, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.009660438, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 583, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.027549293, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000047254 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 287920 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 500, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 502, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 33682537, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 159007, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.052340709, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.012593449, 2024-09-19T08:53:02.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.024305714, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.012017789, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 500, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.016922486, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000033844 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:53:02.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3462, 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.163401675, 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000047198 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-19T08:53:02.693 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 7299, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 3168, 2024-09-19T08:53:02.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 4131, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 2773, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-19T08:53:02.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:53:02.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:53:02.697 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T08:53:02.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:53:02.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 63556, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T08:53:02.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 6, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 34, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 116396120, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 123132093, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 123128671, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 63556 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 23, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 7299, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 7276, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 18, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 261, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 243, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 7299, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 12090, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 4791, 2024-09-19T08:53:02.702 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 66440, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T08:53:02.703 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.704 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T08:53:02.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.710 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T08:53:02.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 3, 2024-09-19T08:53:02.715 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 2, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 1545, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:53:02.716 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:53:02.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T08:53:02.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 231391, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 75, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T08:53:02.719 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 9048, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 170, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 5213050, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 29489, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T08:53:02.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2076, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 26, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 4, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2076, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2076, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.225958451, 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001072234 2024-09-19T08:53:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2076, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2077 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2076, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 2076, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1136, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 937, 2024-09-19T08:53:02.722 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 2, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T08:53:02.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T08:53:02.724 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 90, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 4, 2024-09-19T08:53:02.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 10, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 10, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.726 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:02.727 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2257, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 119791551, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2257, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2257, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 119791551, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2076, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 118950160, 2024-09-19T08:53:02.729 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2076, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 118950160, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T08:53:02.730 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2076, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2076, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2076, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2076, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:53:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.732 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x555dcbbe0b40": { 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T08:53:02.733 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:02.734 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T08:53:03.438 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:03 smithi162 ceph-mon[34870]: pgmap v582: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-19T08:53:03.440 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-19T08:53:03.440 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T08:53:03.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T08:53:03.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:03 smithi018 ceph-mon[30956]: pgmap v582: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-19T08:53:03.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:03 smithi150 ceph-mon[34610]: pgmap v582: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-19T08:53:03.687 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:53:04.175 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2944, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 448, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.003013800, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000034571, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002191755, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:04.176 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.004059776, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001353258 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:53:04.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 130, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 101312, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.008082795, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.005871888, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000762308, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 128, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.006152207, 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000048064 2024-09-19T08:53:04.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 101312 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 175, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 172, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 467120, 2024-09-19T08:53:04.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 105168, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.024461578, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.010522270, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.018457939, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 171, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.009688170, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000056655 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:04.180 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 467120, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 105168 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T08:53:04.181 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:53:04.182 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:53:04.183 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 29, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T08:53:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T08:53:04.185 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T08:53:04.186 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:53:04.187 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T08:53:04.187 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T08:53:04.187 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T08:53:04.187 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 176, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 442395, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 176, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 176, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 442395, 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T08:53:04.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T08:53:04.189 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T08:53:04.189 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T08:53:04.189 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:04.189 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T08:53:04.189 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T08:53:04.857 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-19T08:53:04.857 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T08:53:04.867 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T08:53:04.867 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:53:04.868 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:53:04.890 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:53:04.891 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:53:04.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:53:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:05.383 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:05 smithi018 ceph-mon[30956]: pgmap v583: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:05.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:05 smithi150 ceph-mon[34610]: pgmap v583: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:05.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:05 smithi162 ceph-mon[34870]: pgmap v583: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 -- 172.21.15.18:0/2689718186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8102790 msgr2=0x7f52b81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 --2- 172.21.15.18:0/2689718186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8102790 0x7f52b81067e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009900 tx=0x7f52ac02a410 comp rx=0 tx=0).stop 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 -- 172.21.15.18:0/2689718186 shutdown_connections 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 --2- 172.21.15.18:0/2689718186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52b8106f10 0x7f52b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 --2- 172.21.15.18:0/2689718186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8102790 0x7f52b81067e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 --2- 172.21.15.18:0/2689718186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b8101de0 0x7f52b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 -- 172.21.15.18:0/2689718186 >> 172.21.15.18:0/2689718186 conn(0x7f52b80fd8c0 msgr2=0x7f52b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 -- 172.21.15.18:0/2689718186 shutdown_connections 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.782+0000 7f52be7d7640 1 -- 172.21.15.18:0/2689718186 wait complete. 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 Processor -- start 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 -- start start 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52b8101de0 0x7f52b8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b8102790 0x7f52b81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 0x7f52b819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8111e20 con 0x7f52b8106f10 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8111ca0 con 0x7f52b8101de0 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.783+0000 7f52be7d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8111fa0 con 0x7f52b8102790 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 0x7f52b819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 0x7f52b819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50490/0 (socket says 172.21.15.18:50490) 2024-09-19T08:53:05.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 -- 172.21.15.18:0/600338395 learned_addr learned my addr 172.21.15.18:0/600338395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52b77fe640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b8102790 0x7f52b81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52b7fff640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52b8101de0 0x7f52b8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 -- 172.21.15.18:0/600338395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b8102790 msgr2=0x7f52b81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b8102790 0x7f52b81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 -- 172.21.15.18:0/600338395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52b8101de0 msgr2=0x7f52b8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52b8101de0 0x7f52b8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 -- 172.21.15.18:0/600338395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b819d330 con 0x7f52b8106f10 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52bcd74640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 0x7f52b819cc50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f52b000eaa0 tx=0x7f52b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b000cdb0 con 0x7f52b8106f10 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f52b0005020 con 0x7f52b8106f10 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b819d620 con 0x7f52b8106f10 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b00116d0 con 0x7f52b8106f10 2024-09-19T08:53:05.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.784+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b81a4f00 con 0x7f52b8106f10 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.785+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b81021c0 con 0x7f52b8106f10 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.786+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f52b00051d0 con 0x7f52b8106f10 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.787+0000 7f52b57fa640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f52a00a3240 0x7f52a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.787+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f52b00cfdc0 con 0x7f52b8106f10 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.787+0000 7f52b7fff640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f52a00a3240 0x7f52a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.788+0000 7f52b7fff640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f52a00a3240 0x7f52a00a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005fd0 tx=0x7f52a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.791+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52b0016030 con 0x7f52b8106f10 2024-09-19T08:53:05.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.979+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52b810a150 con 0x7f52b8106f10 2024-09-19T08:53:05.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.980+0000 7f52b57fa640 1 -- 172.21.15.18:0/600338395 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+591 (secure 0 0 0) 0x7f52b00bc0d0 con 0x7f52b8106f10 2024-09-19T08:53:05.979 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2071748034 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:05.979 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2416383067 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2457973928 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4200011478 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/338127021 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3236542074 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:05.980 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-19T08:53:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f52a00a3240 msgr2=0x7f52a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f52a00a3240 0x7f52a00a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005fd0 tx=0x7f52a800b390 comp rx=0 tx=0).stop 2024-09-19T08:53:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 msgr2=0x7f52b819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 0x7f52b819cc50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f52b000eaa0 tx=0x7f52b000ef60 comp rx=0 tx=0).stop 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 shutdown_connections 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f52a00a3240 0x7f52a00a5700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52b8106f10 0x7f52b819cc50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b8102790 0x7f52b81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 --2- 172.21.15.18:0/600338395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52b8101de0 0x7f52b8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 >> 172.21.15.18:0/600338395 conn(0x7f52b80fd8c0 msgr2=0x7f52b80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 shutdown_connections 2024-09-19T08:53:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:05.982+0000 7f52be7d7640 1 -- 172.21.15.18:0/600338395 wait complete. 2024-09-19T08:53:06.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:06 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/600338395' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:53:06.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:06 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/600338395' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:53:06.576 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T08:53:06.576 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:53:06.595 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:53:06.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:06 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/600338395' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:53:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:07.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:07 smithi018 ceph-mon[30956]: pgmap v584: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:07.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.408+0000 7f9556af5640 1 -- 172.21.15.18:0/3078572606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550106a80 msgr2=0x7f9550106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.408+0000 7f9556af5640 1 --2- 172.21.15.18:0/3078572606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550106a80 0x7f9550106e60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9544009930 tx=0x7f954402a420 comp rx=0 tx=0).stop 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.408+0000 7f9556af5640 1 -- 172.21.15.18:0/3078572606 shutdown_connections 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.408+0000 7f9556af5640 1 --2- 172.21.15.18:0/3078572606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550101420 0x7f955010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.408+0000 7f9556af5640 1 --2- 172.21.15.18:0/3078572606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9550100a80 0x7f9550100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.408+0000 7f9556af5640 1 --2- 172.21.15.18:0/3078572606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550106a80 0x7f9550106e60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- 172.21.15.18:0/3078572606 >> 172.21.15.18:0/3078572606 conn(0x7f95500fc7a0 msgr2=0x7f95500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- 172.21.15.18:0/3078572606 shutdown_connections 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- 172.21.15.18:0/3078572606 wait complete. 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 Processor -- start 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- start start 2024-09-19T08:53:07.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 0x7f9550198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550101420 0x7f95501988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9550106a80 0x7f955019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9550110d30 con 0x7f9550100a80 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9550110bb0 con 0x7f9550106a80 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.409+0000 7f9556af5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9550110eb0 con 0x7f9550101420 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 0x7f9550198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 0x7f9550198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50504/0 (socket says 172.21.15.18:50504) 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 -- 172.21.15.18:0/3844359132 learned_addr learned my addr 172.21.15.18:0/3844359132 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9555092640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9550106a80 0x7f955019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f954ffff640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550101420 0x7f95501988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 -- 172.21.15.18:0/3844359132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550101420 msgr2=0x7f95501988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550101420 0x7f95501988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 -- 172.21.15.18:0/3844359132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9550106a80 msgr2=0x7f955019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9550106a80 0x7f955019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 -- 172.21.15.18:0/3844359132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955019d340 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9554891640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 0x7f9550198390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9544004770 tx=0x7f95440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954403f070 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955019d5d0 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f954403b460 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.410+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544035070 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.411+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95501a4f10 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.411+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9550100ee0 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.413+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f954403b610 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.413+0000 7f954dffb640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f95400a3240 0x7f95400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.414+0000 7f954ffff640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f95400a3240 0x7f95400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.414+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f95440f0330 con 0x7f9550100a80 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.414+0000 7f954ffff640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f95400a3240 0x7f95400a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f955006b7e0 tx=0x7f953c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.417+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f95440bcc80 con 0x7f9550100a80 2024-09-19T08:53:07.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:07 smithi150 ceph-mon[34610]: pgmap v584: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:07.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.605+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95501996f0 con 0x7f9550100a80 2024-09-19T08:53:07.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.606+0000 7f954dffb640 1 -- 172.21.15.18:0/3844359132 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+591 (secure 0 0 0) 0x7f95440bc580 con 0x7f9550100a80 2024-09-19T08:53:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2071748034 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2416383067 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2457973928 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4200011478 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/338127021 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/4188004415 2024-09-20T08:36:17.763015+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1687208170 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3236542074 2024-09-20T08:35:53.066097+0000 2024-09-19T08:53:07.606 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-19T08:53:07.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f95400a3240 msgr2=0x7f95400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f95400a3240 0x7f95400a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f955006b7e0 tx=0x7f953c00b590 comp rx=0 tx=0).stop 2024-09-19T08:53:07.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 msgr2=0x7f9550198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 0x7f9550198390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9544004770 tx=0x7f95440042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 shutdown_connections 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f95400a3240 0x7f95400a5700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9550106a80 0x7f955019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550101420 0x7f95501988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 --2- 172.21.15.18:0/3844359132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9550100a80 0x7f9550198390 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 >> 172.21.15.18:0/3844359132 conn(0x7f95500fc7a0 msgr2=0x7f9550104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 shutdown_connections 2024-09-19T08:53:07.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:07.609+0000 7f9556af5640 1 -- 172.21.15.18:0/3844359132 wait complete. 2024-09-19T08:53:07.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:07 smithi162 ceph-mon[34870]: pgmap v584: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:08.309 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-09-19T08:53:08.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:53:08.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T08:53:08.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[83604]: fuse finished with error 0 and tester_r 0 2024-09-19T08:53:08.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:53:08.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:08 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3844359132' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:53:08.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:08 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3844359132' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:53:08.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:08 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3844359132' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:53:09.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:09 smithi018 ceph-mon[30956]: pgmap v585: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:09.462 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:09 smithi150 ceph-mon[34610]: pgmap v585: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:09.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:09 smithi162 ceph-mon[34870]: pgmap v585: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:53:11.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:11 smithi018 ceph-mon[30956]: pgmap v586: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:53:11.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:11 smithi150 ceph-mon[34610]: pgmap v586: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:53:11.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:11 smithi162 ceph-mon[34870]: pgmap v586: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:53:13.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:13 smithi018 ceph-mon[30956]: pgmap v587: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:13.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:13 smithi150 ceph-mon[34610]: pgmap v587: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:13.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:13 smithi162 ceph-mon[34870]: pgmap v587: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:14.441 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:53:14.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:53:14.442 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:53:14.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:53:14.463 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T08:53:14.524 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:53:14.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:53:14.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:53:14.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:53:14.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T08:53:14.694 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T08:53:14.704 INFO:tasks.cephadm:Teardown begin 2024-09-19T08:53:14.704 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:53:14.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:14.966 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:15.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 -- 172.21.15.18:0/2429594171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128106f10 msgr2=0x7f412810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 --2- 172.21.15.18:0/2429594171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128106f10 0x7f412810ea90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4120009ca0 tx=0x7f412002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 -- 172.21.15.18:0/2429594171 shutdown_connections 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 --2- 172.21.15.18:0/2429594171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128106f10 0x7f412810ea90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 --2- 172.21.15.18:0/2429594171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128102790 0x7f41281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 --2- 172.21.15.18:0/2429594171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4128101de0 0x7f41281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 -- 172.21.15.18:0/2429594171 >> 172.21.15.18:0/2429594171 conn(0x7f41280fd8c0 msgr2=0x7f41280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 -- 172.21.15.18:0/2429594171 shutdown_connections 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.419+0000 7f412e6fa640 1 -- 172.21.15.18:0/2429594171 wait complete. 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 Processor -- start 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 -- start start 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4128101de0 0x7f412819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 0x7f412819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128106f10 0x7f412819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4128111e20 con 0x7f4128102790 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4128111ca0 con 0x7f4128101de0 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.420+0000 7f412e6fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4128111fa0 con 0x7f4128106f10 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 0x7f412819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 0x7f412819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49418/0 (socket says 172.21.15.18:49418) 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 -- 172.21.15.18:0/198411167 learned_addr learned my addr 172.21.15.18:0/198411167 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f412cc97640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128106f10 0x7f412819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f4127fff640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4128101de0 0x7f412819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 -- 172.21.15.18:0/198411167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128106f10 msgr2=0x7f412819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128106f10 0x7f412819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 -- 172.21.15.18:0/198411167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4128101de0 msgr2=0x7f412819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4128101de0 0x7f412819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 -- 172.21.15.18:0/198411167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412819f4c0 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f412cc97640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128106f10 0x7f412819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41277fe640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 0x7f412819aa50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f411c00d770 tx=0x7f411c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c017070 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f411c0054d0 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412819f7b0 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.421+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c004cf0 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.422+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281a7090 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.423+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41281021c0 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.424+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f411c004e90 con 0x7f4128102790 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.424+0000 7f41257fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f41100a3240 0x7f41100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.424+0000 7f4127fff640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f41100a3240 0x7f41100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.424+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f411c0cf660 con 0x7f4128102790 2024-09-19T08:53:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.425+0000 7f4127fff640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f41100a3240 0x7f41100a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f411800bbe0 tx=0x7f411800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.429+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f411c09b900 con 0x7f4128102790 2024-09-19T08:53:15.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:15 smithi150 ceph-mon[34610]: pgmap v588: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:15.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.639+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41281a72f0 con 0x7f4128102790 2024-09-19T08:53:15.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:15 smithi018 ceph-mon[30956]: pgmap v588: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.640+0000 7f41257fa640 1 -- 172.21.15.18:0/198411167 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f411c09fc00 con 0x7f4128102790 2024-09-19T08:53:15.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:53:15.640 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:53:15.641 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f41100a3240 msgr2=0x7f41100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f41100a3240 0x7f41100a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f411800bbe0 tx=0x7f411800b390 comp rx=0 tx=0).stop 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 msgr2=0x7f412819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 0x7f412819aa50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f411c00d770 tx=0x7f411c00dc30 comp rx=0 tx=0).stop 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 shutdown_connections 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f41100a3240 0x7f41100a5700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4128106f10 0x7f412819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4128102790 0x7f412819aa50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 --2- 172.21.15.18:0/198411167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4128101de0 0x7f412819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.642+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 >> 172.21.15.18:0/198411167 conn(0x7f41280fd8c0 msgr2=0x7f41280febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.643+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 shutdown_connections 2024-09-19T08:53:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:15.643+0000 7f412e6fa640 1 -- 172.21.15.18:0/198411167 wait complete. 2024-09-19T08:53:15.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:15 smithi162 ceph-mon[34870]: pgmap v588: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:16.298 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:16 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/198411167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:16.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:16.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:16 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/198411167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:16.590 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:16.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:16 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/198411167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:17.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 -- 172.21.15.18:0/1057147812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb8102fc0 msgr2=0x7f7fb81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1057147812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb8102fc0 0x7f7fb81005d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009900 tx=0x7f7fac02a400 comp rx=0 tx=0).stop 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 -- 172.21.15.18:0/1057147812 shutdown_connections 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1057147812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb810e810 0x7f7fb8110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1057147812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb8102fc0 0x7f7fb81005d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1057147812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 0x7f7fb8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 -- 172.21.15.18:0/1057147812 >> 172.21.15.18:0/1057147812 conn(0x7f7fb8077210 msgr2=0x7f7fb80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 -- 172.21.15.18:0/1057147812 shutdown_connections 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.077+0000 7f7fbffba640 1 -- 172.21.15.18:0/1057147812 wait complete. 2024-09-19T08:53:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.078+0000 7f7fbffba640 1 Processor -- start 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.078+0000 7f7fbffba640 1 -- start start 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 0x7f7fb819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb810e810 0x7f7fb819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 0x7f7fb819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb81140a0 con 0x7f7fb819ee50 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb8113f20 con 0x7f7fb8102b50 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb8114220 con 0x7f7fb810e810 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 0x7f7fb819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 0x7f7fb819f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49446/0 (socket says 172.21.15.18:49446) 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 -- 172.21.15.18:0/1680139400 learned_addr learned my addr 172.21.15.18:0/1680139400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbd555640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb810e810 0x7f7fb819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 -- 172.21.15.18:0/1680139400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb810e810 msgr2=0x7f7fb819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb810e810 0x7f7fb819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbdd56640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 0x7f7fb819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 -- 172.21.15.18:0/1680139400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 msgr2=0x7f7fb819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 0x7f7fb819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 -- 172.21.15.18:0/1680139400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb819f910 con 0x7f7fb819ee50 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbdd56640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 0x7f7fb819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbe557640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 0x7f7fb819f300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000d750 tx=0x7f7fb000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0017070 con 0x7f7fb819ee50 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fb00054d0 con 0x7f7fb819ee50 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb819fc00 con 0x7f7fb819ee50 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.079+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0004c60 con 0x7f7fb819ee50 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.080+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb81a7430 con 0x7f7fb819ee50 2024-09-19T08:53:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.080+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb8100090 con 0x7f7fb819ee50 2024-09-19T08:53:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.082+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7fb0004e00 con 0x7f7fb819ee50 2024-09-19T08:53:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.082+0000 7f7fb6ffd640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7fa00a32c0 0x7f7fa00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.082+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7fb00cfae0 con 0x7f7fb819ee50 2024-09-19T08:53:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.082+0000 7f7fbdd56640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7fa00a32c0 0x7f7fa00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.083+0000 7f7fbdd56640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7fa00a32c0 0x7f7fa00a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8005c40 tx=0x7f7fa80082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.085+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7fb009c4b0 con 0x7f7fb819ee50 2024-09-19T08:53:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.300+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fb8103160 con 0x7f7fb819ee50 2024-09-19T08:53:17.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:17 smithi018 ceph-mon[30956]: pgmap v589: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:17.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.301+0000 7f7fb6ffd640 1 -- 172.21.15.18:0/1680139400 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f7fb009bdb0 con 0x7f7fb819ee50 2024-09-19T08:53:17.301 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:53:17.301 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T08:43:56:628067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3031578467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3031578467},{"type":"v1","addr":"172.21.15.18:6835","nonce":3031578467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1252489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1252489164},{"type":"v1","addr":"172.21.15.18:6837","nonce":1252489164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2535601572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2535601572},{"type":"v1","addr":"172.21.15.18:6839","nonce":2535601572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2703044208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2703044208},{"type":"v1","addr":"172.21.15.18:6841","nonce":2703044208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/444164547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":444164547},{"type":"v1","addr":"172.21.15.150:6833","nonce":444164547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/365177303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":365177303},{"type":"v1","addr":"172.21.15.162:6833","nonce":365177303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1640401494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1640401494},{"type":"v1","addr":"172.21.15.150:6835","nonce":1640401494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4142212267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4142212267},{"type":"v1","addr":"172.21.15.150:6837","nonce":4142212267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1358504663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1358504663},{"type":"v1","addr":"172.21.15.162:6835","nonce":1358504663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1673736913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1673736913},{"type":"v1","addr":"172.21.15.162:6837","nonce":1673736913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:43:14.179526+0000","modified":"2024-09-19T08:43:56.358444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/1612914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":1612914765},{"type":"v1","addr":"172.21.15.162:6839","nonce":1612914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6839/3054116303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":3054116303},{"type":"v1","addr":"172.21.15.150:6839","nonce":3054116303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T08:53:17.301 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T08:53:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7fa00a32c0 msgr2=0x7f7fa00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7fa00a32c0 0x7f7fa00a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8005c40 tx=0x7f7fa80082f0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 msgr2=0x7f7fb819f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 0x7f7fb819f300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000d750 tx=0x7f7fb000dc10 comp rx=0 tx=0).stop 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 shutdown_connections 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f7fa00a32c0 0x7f7fa00a5780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb819ee50 0x7f7fb819f300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fb810e810 0x7f7fb819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 --2- 172.21.15.18:0/1680139400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fb8102b50 0x7f7fb819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 >> 172.21.15.18:0/1680139400 conn(0x7f7fb8077210 msgr2=0x7f7fb810fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 shutdown_connections 2024-09-19T08:53:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:17.303+0000 7f7fbffba640 1 -- 172.21.15.18:0/1680139400 wait complete. 2024-09-19T08:53:17.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:17 smithi150 ceph-mon[34610]: pgmap v589: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:17.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:17 smithi162 ceph-mon[34870]: pgmap v589: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:18.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:53:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:18.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1680139400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:18.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:18 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/1680139400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:18.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:18 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/1680139400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:18.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 -- 172.21.15.18:0/3058923534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 msgr2=0x7fbf7410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:18.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/3058923534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf7410d950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009cd0 tx=0x7fbf6c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 -- 172.21.15.18:0/3058923534 shutdown_connections 2024-09-19T08:53:18.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/3058923534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf7410d950 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/3058923534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74100a80 0x7fbf74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/3058923534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf74106a80 0x7fbf74106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 -- 172.21.15.18:0/3058923534 >> 172.21.15.18:0/3058923534 conn(0x7fbf740fc7a0 msgr2=0x7fbf740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 -- 172.21.15.18:0/3058923534 shutdown_connections 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.919+0000 7fbf79fd7640 1 -- 172.21.15.18:0/3058923534 wait complete. 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 Processor -- start 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 -- start start 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf74100a80 0x7fbf74198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf74198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74106a80 0x7fbf7419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74110d30 con 0x7fbf74101420 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74110bb0 con 0x7fbf74100a80 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf79fd7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74110eb0 con 0x7fbf74106a80 2024-09-19T08:53:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf74198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf74198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49452/0 (socket says 172.21.15.18:49452) 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf72ffd640 1 -- 172.21.15.18:0/4127434492 learned_addr learned my addr 172.21.15.18:0/4127434492 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.920+0000 7fbf737fe640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf74100a80 0x7fbf74198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf73fff640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74106a80 0x7fbf7419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf72ffd640 1 -- 172.21.15.18:0/4127434492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74106a80 msgr2=0x7fbf7419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf72ffd640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74106a80 0x7fbf7419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf72ffd640 1 -- 172.21.15.18:0/4127434492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf74100a80 msgr2=0x7fbf74198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf72ffd640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf74100a80 0x7fbf74198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf72ffd640 1 -- 172.21.15.18:0/4127434492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7419d2c0 con 0x7fbf74101420 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf73fff640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74106a80 0x7fbf7419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf72ffd640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf74198850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c970 tx=0x7fbf6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68007bb0 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7419d5b0 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf68007d50 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800f450 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.921+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a4e90 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.922+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74100ee0 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.923+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbf68004f20 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.924+0000 7fbf70ff9640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbf5c0a3240 0x7fbf5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.924+0000 7fbf737fe640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbf5c0a3240 0x7fbf5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.924+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbf680cfac0 con 0x7fbf74101420 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.925+0000 7fbf737fe640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbf5c0a3240 0x7fbf5c0a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf640058c0 tx=0x7fbf6400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:18.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:18.928+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf68014030 con 0x7fbf74101420 2024-09-19T08:53:19.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.108+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf7410a080 con 0x7fbf74101420 2024-09-19T08:53:19.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.110+0000 7fbf70ff9640 1 -- 172.21.15.18:0/4127434492 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24907 (secure 0 0 0) 0x7fbf6809c3b0 con 0x7fbf74101420 2024-09-19T08:53:19.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T08:53:19.110 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":90,"fsid":"ed3de594-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:30.772382+0000","modified":"2024-09-19T08:45:19.553242+0000","last_up_change":"2024-09-19T08:42:20.726072+0000","last_in_change":"2024-09-19T08:41:57.654613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:34.272105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:43:10.423611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:43:12.483763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:43:18.962195+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bb67065-1994-4aa0-92e0-3777a2054efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6803","nonce":2521385669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6805","nonce":2521385669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6809","nonce":2521385669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2521385669},{"type":"v1","addr":"172.21.15.18:6807","nonce":2521385669}]},"public_addr":"172.21.15.18:6803/2521385669","cluster_addr":"172.21.15.18:6805/2521385669","heartbeat_back_addr":"172.21.15.18:6809/2521385669","heartbeat_front_addr":"172.21.15.18:6807/2521385669","state":["exists","up"]},{"osd":1,"uuid":"8bbf03fb-7094-4991-a237-e388fbb0d949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6801","nonce":1031941891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6803","nonce":1031941891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6807","nonce":1031941891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1031941891},{"type":"v1","addr":"172.21.15.150:6805","nonce":1031941891}]},"public_addr":"172.21.15.150:6801/1031941891","cluster_addr":"172.21.15.150:6803/1031941891","heartbeat_back_addr":"172.21.15.150:6807/1031941891","heartbeat_front_addr":"172.21.15.150:6805/1031941891","state":["exists","up"]},{"osd":2,"uuid":"b6aeae03-d039-4b95-bdf4-7484fba94e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6801","nonce":1472595210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6803","nonce":1472595210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6807","nonce":1472595210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1472595210},{"type":"v1","addr":"172.21.15.162:6805","nonce":1472595210}]},"public_addr":"172.21.15.162:6801/1472595210","cluster_addr":"172.21.15.162:6803/1472595210","heartbeat_back_addr":"172.21.15.162:6807/1472595210","heartbeat_front_addr":"172.21.15.162:6805/1472595210","state":["exists","up"]},{"osd":3,"uuid":"0df42fcd-03dc-4b16-b8fb-f1d74227e211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6811","nonce":830246499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6813","nonce":830246499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6817","nonce":830246499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":830246499},{"type":"v1","addr":"172.21.15.18:6815","nonce":830246499}]},"public_addr":"172.21.15.18:6811/830246499","cluster_addr":"172.21.15.18:6813/830246499","heartbeat_back_addr":"172.21.15.18:6817/830246499","heartbeat_front_addr":"172.21.15.18:6815/830246499","state":["exists","up"]},{"osd":4,"uuid":"4942de51-8d38-4707-a4ba-d72fa75043d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6809","nonce":3531191776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6811","nonce":3531191776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6815","nonce":3531191776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3531191776},{"type":"v1","addr":"172.21.15.150:6813","nonce":3531191776}]},"public_addr":"172.21.15.150:6809/3531191776","cluster_addr":"172.21.15.150:6811/3531191776","heartbeat_back_addr":"172.21.15.150:6815/3531191776","heartbeat_front_addr":"172.21.15.150:6813/3531191776","state":["exists","up"]},{"osd":5,"uuid":"3148eeed-0f5a-4d80-8a3d-28d34ce6be50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6809","nonce":2688421502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6811","nonce":2688421502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6815","nonce":2688421502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2688421502},{"type":"v1","addr":"172.21.15.162:6813","nonce":2688421502}]},"public_addr":"172.21.15.162:6809/2688421502","cluster_addr":"172.21.15.162:6811/2688421502","heartbeat_back_addr":"172.21.15.162:6815/2688421502","heartbeat_front_addr":"172.21.15.162:6813/2688421502","state":["exists","up"]},{"osd":6,"uuid":"a4e2e48e-dfd9-4f77-8260-54a8e0385543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6819","nonce":3727051065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6821","nonce":3727051065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6825","nonce":3727051065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3727051065},{"type":"v1","addr":"172.21.15.18:6823","nonce":3727051065}]},"public_addr":"172.21.15.18:6819/3727051065","cluster_addr":"172.21.15.18:6821/3727051065","heartbeat_back_addr":"172.21.15.18:6825/3727051065","heartbeat_front_addr":"172.21.15.18:6823/3727051065","state":["exists","up"]},{"osd":7,"uuid":"a954f75a-ad76-4749-893b-6e30cafcb75a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6817","nonce":2823141522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6819","nonce":2823141522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6823","nonce":2823141522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2823141522},{"type":"v1","addr":"172.21.15.150:6821","nonce":2823141522}]},"public_addr":"172.21.15.150:6817/2823141522","cluster_addr":"172.21.15.150:6819/2823141522","heartbeat_back_addr":"172.21.15.150:6823/2823141522","heartbeat_front_addr":"172.21.15.150:6821/2823141522","state":["exists","up"]},{"osd":8,"uuid":"274f4216-c240-4033-993b-3ff22db0fcb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6817","nonce":2409536118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6819","nonce":2409536118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6823","nonce":2409536118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2409536118},{"type":"v1","addr":"172.21.15.162:6821","nonce":2409536118}]},"public_addr":"172.21.15.162:6817/2409536118","cluster_addr":"172.21.15.162:6819/2409536118","heartbeat_back_addr":"172.21.15.162:6823/2409536118","heartbeat_front_addr":"172.21.15.162:6821/2409536118","state":["exists","up"]},{"osd":9,"uuid":"8d898bb9-3d1f-4650-8419-c381984ff968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6827","nonce":4029412965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6829","nonce":4029412965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6833","nonce":4029412965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4029412965},{"type":"v1","addr":"172.21.15.18:6831","nonce":4029412965}]},"public_addr":"172.21.15.18:6827/4029412965","cluster_addr":"172.21.15.18:6829/4029412965","heartbeat_back_addr":"172.21.15.18:6833/4029412965","heartbeat_front_addr":"172.21.15.18:6831/4029412965","state":["exists","up"]},{"osd":10,"uuid":"06c9dfa6-9639-4595-9bb6-3662c207ac22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6825","nonce":1892479254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6827","nonce":1892479254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6831","nonce":1892479254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":1892479254},{"type":"v1","addr":"172.21.15.150:6829","nonce":1892479254}]},"public_addr":"172.21.15.150:6825/1892479254","cluster_addr":"172.21.15.150:6827/1892479254","heartbeat_back_addr":"172.21.15.150:6831/1892479254","heartbeat_front_addr":"172.21.15.150:6829/1892479254","state":["exists","up"]},{"osd":11,"uuid":"f60b2c94-98f0-49c1-8bd4-08e3c09e1f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6825","nonce":3933246322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6827","nonce":3933246322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6831","nonce":3933246322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3933246322},{"type":"v1","addr":"172.21.15.162:6829","nonce":3933246322}]},"public_addr":"172.21.15.162:6825/3933246322","cluster_addr":"172.21.15.162:6827/3933246322","heartbeat_back_addr":"172.21.15.162:6831/3933246322","heartbeat_front_addr":"172.21.15.162:6829/3933246322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:41.724622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:07.363281+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:31.983766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:57.497918+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:22.554593+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:47.407658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:12.627023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:37.499198+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.564105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.814564+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:54.471024+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:42:19.270157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2071748034":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2416383067":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:0/2457973928":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6800/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/4200011478":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/338127021":"2024-09-20T08:35:53.066097+0000","172.21.15.18:6801/4188004415":"2024-09-20T08:36:17.763015+0000","172.21.15.18:6801/1687208170":"2024-09-20T08:35:53.066097+0000","172.21.15.18:0/3236542074":"2024-09-20T08:35:53.066097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbf5c0a3240 msgr2=0x7fbf5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbf5c0a3240 0x7fbf5c0a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf640058c0 tx=0x7fbf6400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 msgr2=0x7fbf74198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf74198850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c970 tx=0x7fbf6800ce30 comp rx=0 tx=0).stop 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 shutdown_connections 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fbf5c0a3240 0x7fbf5c0a5700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf74106a80 0x7fbf7419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf74101420 0x7fbf74198850 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 --2- 172.21.15.18:0/4127434492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf74100a80 0x7fbf74198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 >> 172.21.15.18:0/4127434492 conn(0x7fbf740fc7a0 msgr2=0x7fbf7406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 shutdown_connections 2024-09-19T08:53:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:19.112+0000 7fbf79fd7640 1 -- 172.21.15.18:0/4127434492 wait complete. 2024-09-19T08:53:19.424 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:19 smithi018 ceph-mon[30956]: pgmap v590: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:19.424 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:19 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4127434492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:53:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:19 smithi150 ceph-mon[34610]: pgmap v590: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:19.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:19 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/4127434492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:53:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:19 smithi162 ceph-mon[34870]: pgmap v590: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:19.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:19 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/4127434492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:53:19.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T08:53:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:20.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/2015633521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 msgr2=0x7fb1c4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/2015633521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4101200 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009900 tx=0x7fb1b402a480 comp rx=0 tx=0).stop 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/2015633521 shutdown_connections 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/2015633521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102ef0 0x7fb1c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/2015633521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c4102570 0x7fb1c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/2015633521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4101200 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/2015633521 >> 172.21.15.18:0/2015633521 conn(0x7fb1c40fc7d0 msgr2=0x7fb1c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/2015633521 shutdown_connections 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.497+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/2015633521 wait complete. 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 Processor -- start 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 -- start start 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102570 0x7fb1c41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c4102ef0 0x7fb1c41a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4110e30 con 0x7fb1c4100e20 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4110cb0 con 0x7fb1c4102ef0 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c8fd0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4110fb0 con 0x7fb1c4102570 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.498+0000 7fb1c259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39138/0 (socket says 172.21.15.18:39138) 2024-09-19T08:53:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 -- 172.21.15.18:0/624619677 learned_addr learned my addr 172.21.15.18:0/624619677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c2d9d640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c4102ef0 0x7fb1c41a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102570 0x7fb1c41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 -- 172.21.15.18:0/624619677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102570 msgr2=0x7fb1c41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102570 0x7fb1c41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 -- 172.21.15.18:0/624619677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c4102ef0 msgr2=0x7fb1c41a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c4102ef0 0x7fb1c41a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 -- 172.21.15.18:0/624619677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41a4840 con 0x7fb1c4100e20 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102570 0x7fb1c41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c259c640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4199280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4006010 tx=0x7fb1b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b403f030 con 0x7fb1c4100e20 2024-09-19T08:53:20.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c41a4a10 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1b4003cb0 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4035070 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.499+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41a4e60 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.500+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4101200 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.501+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb1b4042030 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.502+0000 7fb1b37fe640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.502+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.502+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb1b40f0220 con 0x7fb1c4100e20 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.503+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb1c406aac0 tx=0x7fb1b8005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.506+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1b40bcb10 con 0x7fb1c4100e20 2024-09-19T08:53:20.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.721+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb1c406a560 con 0x7fb1c4100e20 2024-09-19T08:53:20.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.724+0000 7fb1b37fe640 1 -- 172.21.15.18:0/624619677 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fb1b40bc410 con 0x7fb1c4100e20 2024-09-19T08:53:20.723 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:53:20.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.726+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1ac0a3240 msgr2=0x7fb1ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.726+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb1c406aac0 tx=0x7fb1b8005d30 comp rx=0 tx=0).stop 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 msgr2=0x7fb1c4199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4199280 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4006010 tx=0x7fb1b40042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 shutdown_connections 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c4102ef0 0x7fb1c41a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c4102570 0x7fb1c41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 --2- 172.21.15.18:0/624619677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c4100e20 0x7fb1c4199280 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 >> 172.21.15.18:0/624619677 conn(0x7fb1c40fc7d0 msgr2=0x7fb1c40fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 shutdown_connections 2024-09-19T08:53:20.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:20.727+0000 7fb1c8fd0640 1 -- 172.21.15.18:0/624619677 wait complete. 2024-09-19T08:53:21.065 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:53:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: ignoring --setuser ceph since I am not root 2024-09-19T08:53:21.066 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:53:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: ignoring --setgroup ceph since I am not root 2024-09-19T08:53:21.066 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:53:20 smithi150 ceph-mds[64599]: -- 172.21.15.150:0/555999478 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565454d5fc20 con 0x565454d3d400 2024-09-19T08:53:21.066 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:53:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: starting mds.b at 2024-09-19T08:53:21.146 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T08:53:20.722+0000 7f24baa19640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:53:21.169 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:53:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i[65345]: ignoring --setuser ceph since I am not root 2024-09-19T08:53:21.169 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:53:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i[65345]: ignoring --setgroup ceph since I am not root 2024-09-19T08:53:21.169 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:53:20 smithi162 ceph-mds[65349]: -- 172.21.15.162:0/1251216494 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560428e1d860 con 0x560428dfb000 2024-09-19T08:53:21.169 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:53:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i[65345]: starting mds.i at 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: pgmap v591: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/624619677' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/624619677' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:53:21.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:21 smithi018 ceph-mon[30956]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T08:53:21.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:53:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: pgmap v591: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:21.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/624619677' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:53:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:53:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:53:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/624619677' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:53:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:53:21.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:21 smithi150 ceph-mon[34610]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: pgmap v591: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/624619677' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/624619677' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:53:21.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:21 smithi162 ceph-mon[34870]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T08:53:21.789 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 -- 172.21.15.18:0/1515304975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe180103720 msgr2=0x7fe18010bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 --2- 172.21.15.18:0/1515304975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe180103720 0x7fe18010bc10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe168009900 tx=0x7fe16802a480 comp rx=0 tx=0).stop 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 -- 172.21.15.18:0/1515304975 shutdown_connections 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 --2- 172.21.15.18:0/1515304975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe18010c1a0 0x7fe18010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 --2- 172.21.15.18:0/1515304975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe180103720 0x7fe18010bc10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 --2- 172.21.15.18:0/1515304975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe180102e00 0x7fe1801031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 -- 172.21.15.18:0/1515304975 >> 172.21.15.18:0/1515304975 conn(0x7fe1800fc7a0 msgr2=0x7fe1800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.266+0000 7fe184c1e640 1 -- 172.21.15.18:0/1515304975 shutdown_connections 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.267+0000 7fe184c1e640 1 -- 172.21.15.18:0/1515304975 wait complete. 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.267+0000 7fe184c1e640 1 Processor -- start 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 -- start start 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe180102e00 0x7fe180198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe180103720 0x7fe180198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 0x7fe18019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe180111e20 con 0x7fe18010c1a0 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe180111ca0 con 0x7fe180103720 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe184c1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe180111fa0 con 0x7fe180102e00 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 0x7fe18019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 0x7fe18019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39152/0 (socket says 172.21.15.18:39152) 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 -- 172.21.15.18:0/649739535 learned_addr learned my addr 172.21.15.18:0/649739535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17e59c640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe180102e00 0x7fe180198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe177fff640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe180103720 0x7fe180198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 -- 172.21.15.18:0/649739535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe180102e00 msgr2=0x7fe180198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe180102e00 0x7fe180198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 -- 172.21.15.18:0/649739535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe180103720 msgr2=0x7fe180198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe180103720 0x7fe180198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 -- 172.21.15.18:0/649739535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18019d3b0 con 0x7fe18010c1a0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe177fff640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe180103720 0x7fe180198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.268+0000 7fe17ed9d640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 0x7fe18019ccd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe17800cce0 tx=0x7fe17800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.269+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17800f450 con 0x7fe18010c1a0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.269+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe17800faa0 con 0x7fe18010c1a0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.269+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18019d6a0 con 0x7fe18010c1a0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.269+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178018b70 con 0x7fe18010c1a0 2024-09-19T08:53:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.269+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1801a4f80 con 0x7fe18010c1a0 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.270+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1801031e0 con 0x7fe18010c1a0 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.271+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe178018d10 con 0x7fe18010c1a0 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.271+0000 7fe1777fe640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe16c0a3240 0x7fe16c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.271+0000 7fe17e59c640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe16c0a3240 0x7fe16c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.272+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9294+0+0 (secure 0 0 0) 0x7fe1780d01b0 con 0x7fe18010c1a0 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.272+0000 7fe17e59c640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe16c0a3240 0x7fe16c0a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe170005fd0 tx=0x7fe170005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.276+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe178014030 con 0x7fe18010c1a0 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6838/3282550395,v1:172.21.15.162:6839/3282550395] up:boot 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.150:6838/2439510897,v1:172.21.15.150:6839/2439510897] up:boot 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:53:22.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:53:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:22.488+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe180199760 con 0x7fe18010c1a0 2024-09-19T08:53:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:22.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:22.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:53:22.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.162:6838/3282550395,v1:172.21.15.162:6839/3282550395] up:boot 2024-09-19T08:53:22.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: mds.? [v2:172.21.15.150:6838/2439510897,v1:172.21.15.150:6839/2439510897] up:boot 2024-09-19T08:53:22.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T08:53:22.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:53:22.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:22 smithi150 ceph-mon[34610]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.162:6838/3282550395,v1:172.21.15.162:6839/3282550395] up:boot 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: mds.? [v2:172.21.15.150:6838/2439510897,v1:172.21.15.150:6839/2439510897] up:boot 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:53:22.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:22 smithi162 ceph-mon[34870]: from='mgr.14150 172.21.15.18:0/4288896487' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:53:23.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.222+0000 7fe1777fe640 1 -- 172.21.15.18:0/649739535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7fe17809cab0 con 0x7fe18010c1a0 2024-09-19T08:53:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.224+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe16c0a3240 msgr2=0x7fe16c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.224+0000 7fe184c1e640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe16c0a3240 0x7fe16c0a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe170005fd0 tx=0x7fe170005850 comp rx=0 tx=0).stop 2024-09-19T08:53:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.224+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 msgr2=0x7fe18019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.224+0000 7fe184c1e640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 0x7fe18019ccd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe17800cce0 tx=0x7fe17800a620 comp rx=0 tx=0).stop 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 shutdown_connections 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fe16c0a3240 0x7fe16c0a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18010c1a0 0x7fe18019ccd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe180103720 0x7fe180198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 --2- 172.21.15.18:0/649739535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe180102e00 0x7fe180198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 >> 172.21.15.18:0/649739535 conn(0x7fe1800fc7a0 msgr2=0x7fe1800fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 shutdown_connections 2024-09-19T08:53:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:23.225+0000 7fe184c1e640 1 -- 172.21.15.18:0/649739535 wait complete. 2024-09-19T08:53:23.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:23 smithi018 ceph-mon[30956]: pgmap v593: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-09-19T08:53:23.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:23 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/649739535' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:53:23.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:23 smithi150 ceph-mon[34610]: pgmap v593: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-09-19T08:53:23.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:23 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/649739535' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:53:23.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:23 smithi162 ceph-mon[34870]: pgmap v593: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-09-19T08:53:23.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:23 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/649739535' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:53:23.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:53:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:24.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:24 smithi018 ceph-mon[30956]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:53:24.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:24 smithi018 ceph-mon[30956]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:53:24.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:24 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T08:53:24.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/649739535' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:53:24.469 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:24 smithi018 ceph-mon[30956]: fsmap 12 up:standby 2024-09-19T08:53:24.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:24 smithi150 ceph-mon[34610]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:53:24.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:24 smithi150 ceph-mon[34610]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:53:24.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:24 smithi150 ceph-mon[34610]: Cluster is now healthy 2024-09-19T08:53:24.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:24 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/649739535' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:53:24.566 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:24 smithi150 ceph-mon[34610]: fsmap 12 up:standby 2024-09-19T08:53:24.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:24 smithi162 ceph-mon[34870]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:53:24.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:24 smithi162 ceph-mon[34870]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:53:24.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:24 smithi162 ceph-mon[34870]: Cluster is now healthy 2024-09-19T08:53:24.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:24 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/649739535' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:53:24.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:24 smithi162 ceph-mon[34870]: fsmap 12 up:standby 2024-09-19T08:53:24.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 -- 172.21.15.18:0/271646246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8101de0 msgr2=0x7fb1a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/271646246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8101de0 0x7fb1a81021c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009900 tx=0x7fb1a402a410 comp rx=0 tx=0).stop 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 -- 172.21.15.18:0/271646246 shutdown_connections 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/271646246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a8106f10 0x7fb1a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/271646246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 0x7fb1a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/271646246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8101de0 0x7fb1a81021c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 -- 172.21.15.18:0/271646246 >> 172.21.15.18:0/271646246 conn(0x7fb1a80fd8c0 msgr2=0x7fb1a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 -- 172.21.15.18:0/271646246 shutdown_connections 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.677+0000 7fb1b01fc640 1 -- 172.21.15.18:0/271646246 wait complete. 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 Processor -- start 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 -- start start 2024-09-19T08:53:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a8101de0 0x7fb1a8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 0x7fb1a81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 0x7fb1a819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8111de0 con 0x7fb1a8106f10 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8111c60 con 0x7fb1a8102790 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1b01fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8111f60 con 0x7fb1a8101de0 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 0x7fb1a819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 0x7fb1a819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39168/0 (socket says 172.21.15.18:39168) 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 -- 172.21.15.18:0/878389689 learned_addr learned my addr 172.21.15.18:0/878389689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ad797640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 0x7fb1a81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1adf98640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a8101de0 0x7fb1a8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 -- 172.21.15.18:0/878389689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a8101de0 msgr2=0x7fb1a8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a8101de0 0x7fb1a8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 -- 172.21.15.18:0/878389689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 msgr2=0x7fb1a81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 0x7fb1a81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ae799640 1 -- 172.21.15.18:0/878389689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a819d330 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.678+0000 7fb1ad797640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 0x7fb1a81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.679+0000 7fb1ae799640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 0x7fb1a819cc50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000eaa0 tx=0x7fb1a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.679+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000cdb0 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.679+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1a0005020 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.679+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a819d620 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.679+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00116d0 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.679+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a81a4f00 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.680+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a81021c0 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.681+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb1a00051d0 con 0x7fb1a8106f10 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.682+0000 7fb19effd640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1940a32c0 0x7fb1940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.682+0000 7fb1adf98640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1940a32c0 0x7fb1940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.682+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9294+0+0 (secure 0 0 0) 0x7fb1a00cfdc0 con 0x7fb1a8106f10 2024-09-19T08:53:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.682+0000 7fb1adf98640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1940a32c0 0x7fb1940a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4031440 tx=0x7fb1a4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.686+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1a0016030 con 0x7fb1a8106f10 2024-09-19T08:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:24.863+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1a802d7c0 con 0x7fb1a8106f10 2024-09-19T08:53:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.228+0000 7fb19effd640 1 -- 172.21.15.18:0/878389689 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fb1a009c070 con 0x7fb1a8106f10 2024-09-19T08:53:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1940a32c0 msgr2=0x7fb1940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1940a32c0 0x7fb1940a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4031440 tx=0x7fb1a4005b50 comp rx=0 tx=0).stop 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 msgr2=0x7fb1a819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 0x7fb1a819cc50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000eaa0 tx=0x7fb1a000ef60 comp rx=0 tx=0).stop 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 shutdown_connections 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fb1940a32c0 0x7fb1940a5780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a8106f10 0x7fb1a819cc50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1a8102790 0x7fb1a81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 --2- 172.21.15.18:0/878389689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a8101de0 0x7fb1a8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 >> 172.21.15.18:0/878389689 conn(0x7fb1a80fd8c0 msgr2=0x7fb1a80fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 shutdown_connections 2024-09-19T08:53:25.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:25.233+0000 7fb1b01fc640 1 -- 172.21.15.18:0/878389689 wait complete. 2024-09-19T08:53:25.552 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:25 smithi018 ceph-mon[30956]: pgmap v594: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:25 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/878389689' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:25.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:25 smithi150 ceph-mon[34610]: pgmap v594: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-09-19T08:53:25.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:25 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/878389689' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:25 smithi162 ceph-mon[34870]: pgmap v594: 129 pgs: 129 active+clean; 11 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-09-19T08:53:25.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:25 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/878389689' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:25.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:53:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:26.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:26 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/878389689' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:26.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:26 smithi150 ceph-mon[34610]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:53:26.574 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/878389689' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:26.574 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:26 smithi018 ceph-mon[30956]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 -- 172.21.15.18:0/2739965304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 msgr2=0x7fca381029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 --2- 172.21.15.18:0/2739965304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381029b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009900 tx=0x7fca2c02a480 comp rx=0 tx=0).stop 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 -- 172.21.15.18:0/2739965304 shutdown_connections 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 --2- 172.21.15.18:0/2739965304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca38102ef0 0x7fca3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 --2- 172.21.15.18:0/2739965304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381029b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 --2- 172.21.15.18:0/2739965304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca38100e20 0x7fca38101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 -- 172.21.15.18:0/2739965304 >> 172.21.15.18:0/2739965304 conn(0x7fca380fc7d0 msgr2=0x7fca380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 -- 172.21.15.18:0/2739965304 shutdown_connections 2024-09-19T08:53:26.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.660+0000 7fca3f069640 1 -- 172.21.15.18:0/2739965304 wait complete. 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 Processor -- start 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 -- start start 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca38100e20 0x7fca38198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca38102ef0 0x7fca3819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca38110e30 con 0x7fca38102570 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fca38110cb0 con 0x7fca38100e20 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3f069640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca38110fb0 con 0x7fca38102ef0 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39188/0 (socket says 172.21.15.18:39188) 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca37fff640 1 -- 172.21.15.18:0/40743567 learned_addr learned my addr 172.21.15.18:0/40743567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:26.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.661+0000 7fca3ce05640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca38100e20 0x7fca38198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca3d606640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca38102ef0 0x7fca3819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca37fff640 1 -- 172.21.15.18:0/40743567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca38102ef0 msgr2=0x7fca3819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca37fff640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca38102ef0 0x7fca3819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca37fff640 1 -- 172.21.15.18:0/40743567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca38100e20 msgr2=0x7fca38198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca37fff640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca38100e20 0x7fca38198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca37fff640 1 -- 172.21.15.18:0/40743567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3819d440 con 0x7fca38102570 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca37fff640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381989d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fca2c006010 tx=0x7fca2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03f030 con 0x7fca38102570 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca2c003cb0 con 0x7fca38102570 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c035070 con 0x7fca38102570 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.662+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3819d6d0 con 0x7fca38102570 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.663+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3819db60 con 0x7fca38102570 2024-09-19T08:53:26.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.664+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca38101200 con 0x7fca38102570 2024-09-19T08:53:26.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.665+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca2c042030 con 0x7fca38102570 2024-09-19T08:53:26.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.665+0000 7fca35ffb640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fca200a32c0 0x7fca200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.666+0000 7fca3ce05640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fca200a32c0 0x7fca200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.666+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8711+0+0 (secure 0 0 0) 0x7fca2c0effd0 con 0x7fca38102570 2024-09-19T08:53:26.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.666+0000 7fca3ce05640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fca200a32c0 0x7fca200a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bbe0 tx=0x7fca2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.671 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:26 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/878389689' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:26.671 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:26 smithi162 ceph-mon[34870]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:53:26.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.670+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca2c0bcab0 con 0x7fca38102570 2024-09-19T08:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:26.846+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fca3810a0d0 con 0x7fca38102570 2024-09-19T08:53:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.238+0000 7fca35ffb640 1 -- 172.21.15.18:0/40743567 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7fca2c0bc3b0 con 0x7fca38102570 2024-09-19T08:53:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T08:53:27.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fca200a32c0 msgr2=0x7fca200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fca200a32c0 0x7fca200a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bbe0 tx=0x7fca2800b390 comp rx=0 tx=0).stop 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 msgr2=0x7fca381989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381989d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fca2c006010 tx=0x7fca2c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 shutdown_connections 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7fca200a32c0 0x7fca200a5780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca38102ef0 0x7fca3819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38102570 0x7fca381989d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 --2- 172.21.15.18:0/40743567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca38100e20 0x7fca38198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 >> 172.21.15.18:0/40743567 conn(0x7fca380fc7d0 msgr2=0x7fca3806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 shutdown_connections 2024-09-19T08:53:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:27.243+0000 7fca3f069640 1 -- 172.21.15.18:0/40743567 wait complete. 2024-09-19T08:53:27.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:27 smithi150 ceph-mon[34610]: pgmap v596: 97 pgs: 97 active+clean; 577 KiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:27.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:27 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/40743567' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:27.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:27 smithi018 ceph-mon[30956]: pgmap v596: 97 pgs: 97 active+clean; 577 KiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:27.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/40743567' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:27.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:27 smithi162 ceph-mon[34870]: pgmap v596: 97 pgs: 97 active+clean; 577 KiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:27.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:27 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/40743567' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:27.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ed3de594-7661-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T08:53:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:28.511 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/40743567' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:28.511 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:28 smithi018 ceph-mon[30956]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:53:28.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:28 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/40743567' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:28.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:28 smithi150 ceph-mon[34610]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:53:28.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:28 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/40743567' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:28.667 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:28 smithi162 ceph-mon[34870]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 -- 172.21.15.18:0/2029215740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1082a0 msgr2=0x7f42cc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/2029215740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1082a0 0x7f42cc10ec40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009cd0 tx=0x7f42c402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 -- 172.21.15.18:0/2029215740 shutdown_connections 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/2029215740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1082a0 0x7f42cc10ec40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/2029215740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42cc1036e0 0x7f42cc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/2029215740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc102d30 0x7f42cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 -- 172.21.15.18:0/2029215740 >> 172.21.15.18:0/2029215740 conn(0x7f42cc0fc7d0 msgr2=0x7f42cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 -- 172.21.15.18:0/2029215740 shutdown_connections 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.703+0000 7f42d1a6a640 1 -- 172.21.15.18:0/2029215740 wait complete. 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.704+0000 7f42d1a6a640 1 Processor -- start 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.704+0000 7f42d1a6a640 1 -- start start 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42d1a6a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42cc102d30 0x7f42cc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42d1a6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 0x7f42cc1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42d1a6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc1082a0 0x7f42cc19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42d1a6a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc111f50 con 0x7f42cc1036e0 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42d1a6a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc111dd0 con 0x7f42cc102d30 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42d1a6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1120d0 con 0x7f42cc1082a0 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 0x7f42cc1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 0x7f42cc1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39194/0 (socket says 172.21.15.18:39194) 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 -- 172.21.15.18:0/3156542316 learned_addr learned my addr 172.21.15.18:0/3156542316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42cb7fe640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42cc102d30 0x7f42cc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42cbfff640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc1082a0 0x7f42cc19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 -- 172.21.15.18:0/3156542316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc1082a0 msgr2=0x7f42cc19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc1082a0 0x7f42cc19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 -- 172.21.15.18:0/3156542316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42cc102d30 msgr2=0x7f42cc1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42cc102d30 0x7f42cc1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 -- 172.21.15.18:0/3156542316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc19d450 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42cbfff640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc1082a0 0x7f42cc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42caffd640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 0x7f42cc1989e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f42c000d740 tx=0x7f42c000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0017070 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.705+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42c000de50 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.706+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc19d740 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.706+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c000f620 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.706+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc1a5020 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.707+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc103110 con 0x7f42cc1036e0 2024-09-19T08:53:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.708+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f42c001a070 con 0x7f42cc1036e0 2024-09-19T08:53:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.708+0000 7f42c8ff9640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42b40a3240 0x7f42b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.709+0000 7f42cb7fe640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42b40a3240 0x7f42b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.709+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8152+0+0 (secure 0 0 0) 0x7f42c00cf2f0 con 0x7f42cc1036e0 2024-09-19T08:53:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.709+0000 7f42cb7fe640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42b40a3240 0x7f42b40a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005fd0 tx=0x7f42bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.713+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42c009c010 con 0x7f42cc1036e0 2024-09-19T08:53:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:28.890+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42cc10a2e0 con 0x7f42cc1036e0 2024-09-19T08:53:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.246+0000 7f42c8ff9640 1 -- 172.21.15.18:0/3156542316 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v94) ==== 178+0+0 (secure 0 0 0) 0x7f42c009b910 con 0x7f42cc1036e0 2024-09-19T08:53:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2024-09-19T08:53:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42b40a3240 msgr2=0x7f42b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42b40a3240 0x7f42b40a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005fd0 tx=0x7f42bc00b390 comp rx=0 tx=0).stop 2024-09-19T08:53:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 msgr2=0x7f42cc1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 0x7f42cc1989e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f42c000d740 tx=0x7f42c000dc00 comp rx=0 tx=0).stop 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 shutdown_connections 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:6800/2747026181,v1:172.21.15.18:6801/2747026181] conn(0x7f42b40a3240 0x7f42b40a5700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42cc1082a0 0x7f42cc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42cc1036e0 0x7f42cc1989e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 --2- 172.21.15.18:0/3156542316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42cc102d30 0x7f42cc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.249+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 >> 172.21.15.18:0/3156542316 conn(0x7f42cc0fc7d0 msgr2=0x7f42cc105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.250+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 shutdown_connections 2024-09-19T08:53:29.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T08:53:29.251+0000 7f42d1a6a640 1 -- 172.21.15.18:0/3156542316 wait complete. 2024-09-19T08:53:29.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:29 smithi150 ceph-mon[34610]: pgmap v598: 33 pgs: 33 active+clean; 577 KiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:29.565 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:29 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3156542316' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:29.568 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:29 smithi162 ceph-mon[34870]: pgmap v598: 33 pgs: 33 active+clean; 577 KiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:29.568 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:29 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3156542316' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:29.588 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:29 smithi018 ceph-mon[30956]: pgmap v598: 33 pgs: 33 active+clean; 577 KiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:29.588 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:29 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3156542316' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:53:29.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:29.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:30.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:30.056 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T08:53:30.056 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:53:30.073 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:53:30.087 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:53:30.113 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T08:53:30.113 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T08:53:30.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:53:30.193 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 systemd[1]: Stopping Ceph mon.a for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:30.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:30 smithi150 ceph-mon[34610]: from='client.? 172.21.15.18:0/3156542316' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:30.315 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:30 smithi150 ceph-mon[34610]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:53:30.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:30 smithi162 ceph-mon[34870]: from='client.? 172.21.15.18:0/3156542316' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:30.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:30 smithi162 ceph-mon[34870]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:53:30.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3156542316' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:53:30.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 ceph-mon[30956]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:53:30.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T08:53:30.435+0000 7f24c0224640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:30.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T08:53:30.435+0000 7f24c0224640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T08:53:30.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 podman[107508]: 2024-09-19 08:53:30.487522158 +0000 UTC m=+0.176887304 container died d701052a226b12601f3bbdfe793ba2d4c5ccd0373325a599cc6e63842b4a35f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T08:53:31.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 podman[107508]: 2024-09-19 08:53:30.894364637 +0000 UTC m=+0.583729818 container cleanup d701052a226b12601f3bbdfe793ba2d4c5ccd0373325a599cc6e63842b4a35f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T08:53:31.154 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 08:53:30 smithi018 bash[107508]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:53:31.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T08:53:31.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:31.328 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T08:53:31.328 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T08:53:31.328 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.b 2024-09-19T08:53:31.632 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:31 smithi150 systemd[1]: Stopping Ceph mon.b for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-b[34606]: 2024-09-19T08:53:31.631+0000 7fd632e8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:32.065 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-b[34606]: 2024-09-19T08:53:31.631+0000 7fd632e8d640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:53:32.066 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:31 smithi150 podman[67999]: 2024-09-19 08:53:31.723759242 +0000 UTC m=+0.212996450 container died c40312751b19e215414889f9dedc51838cdd8162cf3d27f60cfe2748ff09b442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:53:32.503 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:32 smithi150 podman[67999]: 2024-09-19 08:53:32.282623573 +0000 UTC m=+0.771860770 container cleanup c40312751b19e215414889f9dedc51838cdd8162cf3d27f60cfe2748ff09b442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T08:53:32.503 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:32 smithi150 bash[67999]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-b 2024-09-19T08:53:32.751 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T08:53:32.774 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:32 smithi150 podman[68012]: 2024-09-19 08:53:32.501225026 +0000 UTC m=+0.774890457 container remove c40312751b19e215414889f9dedc51838cdd8162cf3d27f60cfe2748ff09b442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:53:32.774 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:32 smithi150 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T08:53:32.774 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:32 smithi150 systemd[1]: Stopped Ceph mon.b for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:53:32.774 INFO:journalctl@ceph.mon.b.smithi150.stdout:Sep 19 08:53:32 smithi150 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.b.service: Consumed 9.440s CPU time. 2024-09-19T08:53:32.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:32.832 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T08:53:32.832 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T08:53:32.832 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.c 2024-09-19T08:53:33.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:32 smithi162 systemd[1]: Stopping Ceph mon.c for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:33.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-c[34866]: 2024-09-19T08:53:33.165+0000 7f8e13bf3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:33.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-c[34866]: 2024-09-19T08:53:33.165+0000 7f8e13bf3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:53:33.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:33 smithi162 podman[69191]: 2024-09-19 08:53:33.278001801 +0000 UTC m=+0.244522424 container died 45df618ba8fcd21af27160ead3598cdabfe1c84a4119033fa1aa500201f8b6cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:53:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:33 smithi162 podman[69191]: 2024-09-19 08:53:33.657740887 +0000 UTC m=+0.624261510 container cleanup 45df618ba8fcd21af27160ead3598cdabfe1c84a4119033fa1aa500201f8b6cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-19T08:53:33.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 08:53:33 smithi162 bash[69191]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mon-c 2024-09-19T08:53:34.092 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T08:53:34.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:34.143 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T08:53:34.144 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T08:53:34.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:53:34.444 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:34 smithi018 systemd[1]: Stopping Ceph mgr.x for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:34.818 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:53:34.465+0000 7fda52226640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:34.818 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T08:53:34.465+0000 7fda52226640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T08:53:34.818 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:34 smithi018 podman[107629]: 2024-09-19 08:53:34.49703585 +0000 UTC m=+0.157495698 container died 93393142f36abde5c8e0213d4ac5ffb5e8d91bdd33938ea08422be8ad260a91e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:53:35.160 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:34 smithi018 podman[107629]: 2024-09-19 08:53:34.925367919 +0000 UTC m=+0.585827766 container cleanup 93393142f36abde5c8e0213d4ac5ffb5e8d91bdd33938ea08422be8ad260a91e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T08:53:35.160 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:34 smithi018 bash[107629]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x 2024-09-19T08:53:35.411 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 08:53:35 smithi018 podman[107640]: 2024-09-19 08:53:35.160687379 +0000 UTC m=+0.661048351 container remove 93393142f36abde5c8e0213d4ac5ffb5e8d91bdd33938ea08422be8ad260a91e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T08:53:35.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T08:53:35.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:35.449 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T08:53:35.449 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T08:53:35.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.y 2024-09-19T08:53:35.799 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:53:35 smithi150 systemd[1]: Stopping Ceph mgr.y for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:36.065 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:53:35 smithi150 podman[68123]: 2024-09-19 08:53:35.800189491 +0000 UTC m=+0.155806771 container died 8b6d7326af270bf93f1602479525133964b72a7e5cb6525ab9ffc664caded82c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:53:36.473 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:53:36 smithi150 podman[68123]: 2024-09-19 08:53:36.180227847 +0000 UTC m=+0.535845135 container cleanup 8b6d7326af270bf93f1602479525133964b72a7e5cb6525ab9ffc664caded82c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:53:36.473 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Sep 19 08:53:36 smithi150 bash[68123]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-y 2024-09-19T08:53:36.653 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T08:53:36.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:36.688 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T08:53:36.688 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T08:53:36.688 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.z 2024-09-19T08:53:37.017 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:36 smithi162 systemd[1]: Stopping Ceph mgr.z for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:37.321 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 podman[69318]: 2024-09-19 08:53:37.016991454 +0000 UTC m=+0.136378656 container died 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T08:53:37.664 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 podman[69318]: 2024-09-19 08:53:37.429760357 +0000 UTC m=+0.549147558 container cleanup 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T08:53:37.664 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 bash[69318]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z 2024-09-19T08:53:37.914 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 podman[69331]: 2024-09-19 08:53:37.66522918 +0000 UTC m=+0.643571247 container remove 702bb604e12ee65e8c829dbe70e65ac67aacc841fa7731e7d7016060877443bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:53:37.914 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T08:53:37.915 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-19T08:53:37.915 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 08:53:37 smithi162 systemd[1]: Stopped Ceph mgr.z for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:53:37.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T08:53:37.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:37.952 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T08:53:37.952 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T08:53:37.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.0 2024-09-19T08:53:38.271 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:38 smithi018 systemd[1]: Stopping Ceph osd.0 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:38.550 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0[45134]: 2024-09-19T08:53:38.270+0000 7fd92623d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:38.550 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0[45134]: 2024-09-19T08:53:38.270+0000 7fd92623d640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-19T08:53:38.550 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0[45134]: 2024-09-19T08:53:38.270+0000 7fd92623d640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:53:43.999 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:43 smithi018 podman[107750]: 2024-09-19 08:53:43.695171356 +0000 UTC m=+5.540572919 container died f91a402024677fda96edfdf27db499a8a6dc3b05c74578fcd609afd4bd9950e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:53:44.556 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:44 smithi018 podman[107750]: 2024-09-19 08:53:44.263600253 +0000 UTC m=+6.109001806 container cleanup f91a402024677fda96edfdf27db499a8a6dc3b05c74578fcd609afd4bd9950e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T08:53:44.556 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:44 smithi018 bash[107750]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0 2024-09-19T08:53:44.892 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:44 smithi018 podman[107778]: 2024-09-19 08:53:44.556790817 +0000 UTC m=+0.852624883 container remove f91a402024677fda96edfdf27db499a8a6dc3b05c74578fcd609afd4bd9950e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:53:45.176 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:44 smithi018 podman[107871]: 2024-09-19 08:53:44.796043479 +0000 UTC m=+0.016473511 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:53:45.176 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:44 smithi018 podman[107871]: 2024-09-19 08:53:44.916247437 +0000 UTC m=+0.136677498 container create fc159a8377e2462ad4c2a08ce20e8974282b223dfd669b185d024026c582fe3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:53:45.176 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:45 smithi018 podman[107871]: 2024-09-19 08:53:45.177178719 +0000 UTC m=+0.397608747 container init fc159a8377e2462ad4c2a08ce20e8974282b223dfd669b185d024026c582fe3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T08:53:45.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:45 smithi018 podman[107871]: 2024-09-19 08:53:45.180803482 +0000 UTC m=+0.401233508 container start fc159a8377e2462ad4c2a08ce20e8974282b223dfd669b185d024026c582fe3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T08:53:45.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:45 smithi018 podman[107871]: 2024-09-19 08:53:45.277712879 +0000 UTC m=+0.498142914 container attach fc159a8377e2462ad4c2a08ce20e8974282b223dfd669b185d024026c582fe3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T08:53:45.444 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 08:53:45 smithi018 podman[107871]: 2024-09-19 08:53:45.37380109 +0000 UTC m=+0.594231122 container died fc159a8377e2462ad4c2a08ce20e8974282b223dfd669b185d024026c582fe3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T08:53:46.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T08:53:46.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:46.179 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T08:53:46.179 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T08:53:46.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.1 2024-09-19T08:53:46.502 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:46 smithi150 systemd[1]: Stopping Ceph osd.1 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:46.815 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1[39063]: 2024-09-19T08:53:46.502+0000 7fa743348640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:46.815 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1[39063]: 2024-09-19T08:53:46.502+0000 7fa743348640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-19T08:53:46.815 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1[39063]: 2024-09-19T08:53:46.502+0000 7fa743348640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:53:52.378 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:52 smithi150 podman[68247]: 2024-09-19 08:53:52.074263802 +0000 UTC m=+5.693143491 container died e97a463b48bb323bb39e6b38bc36b06c33c69bbba8ed6acb28f6da9e0937a2c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:53:52.737 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:52 smithi150 podman[68247]: 2024-09-19 08:53:52.461392786 +0000 UTC m=+6.080272465 container cleanup e97a463b48bb323bb39e6b38bc36b06c33c69bbba8ed6acb28f6da9e0937a2c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T08:53:52.737 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:52 smithi150 bash[68247]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1 2024-09-19T08:53:53.065 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:52 smithi150 podman[68262]: 2024-09-19 08:53:52.737961675 +0000 UTC m=+0.663592661 container remove e97a463b48bb323bb39e6b38bc36b06c33c69bbba8ed6acb28f6da9e0937a2c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T08:53:53.383 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:53 smithi150 podman[68350]: 2024-09-19 08:53:52.983288559 +0000 UTC m=+0.015922481 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:53:53.383 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:53 smithi150 podman[68350]: 2024-09-19 08:53:53.114200503 +0000 UTC m=+0.146834405 container create 444a44f047b3818563aeda5117381db06c57e301369cbf71e0f3f0f3e3530d67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T08:53:53.815 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:53 smithi150 podman[68350]: 2024-09-19 08:53:53.383798604 +0000 UTC m=+0.416432521 container init 444a44f047b3818563aeda5117381db06c57e301369cbf71e0f3f0f3e3530d67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T08:53:53.816 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:53 smithi150 podman[68350]: 2024-09-19 08:53:53.387754417 +0000 UTC m=+0.420388328 container start 444a44f047b3818563aeda5117381db06c57e301369cbf71e0f3f0f3e3530d67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:53:53.816 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:53 smithi150 podman[68350]: 2024-09-19 08:53:53.49210538 +0000 UTC m=+0.524739305 container attach 444a44f047b3818563aeda5117381db06c57e301369cbf71e0f3f0f3e3530d67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T08:53:53.816 INFO:journalctl@ceph.osd.1.smithi150.stdout:Sep 19 08:53:53 smithi150 podman[68350]: 2024-09-19 08:53:53.579616196 +0000 UTC m=+0.612250109 container died 444a44f047b3818563aeda5117381db06c57e301369cbf71e0f3f0f3e3530d67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T08:53:54.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T08:53:54.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:53:54.266 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T08:53:54.266 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T08:53:54.266 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.2 2024-09-19T08:53:54.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:53:54 smithi162 systemd[1]: Stopping Ceph osd.2 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:53:54.917 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:53:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2[39808]: 2024-09-19T08:53:54.631+0000 7f266d053640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:54.917 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:53:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2[39808]: 2024-09-19T08:53:54.631+0000 7f266d053640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-19T08:53:54.917 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:53:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2[39808]: 2024-09-19T08:53:54.631+0000 7f266d053640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:00.391 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:00 smithi162 podman[69446]: 2024-09-19 08:54:00.085657861 +0000 UTC m=+5.617776726 container died 03bd6494c31b1cdc4cb9192149e31b46cd9cf69b1e73b3a9404d13d1811e31a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T08:54:00.667 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:00 smithi162 podman[69446]: 2024-09-19 08:54:00.516086388 +0000 UTC m=+6.048205253 container cleanup 03bd6494c31b1cdc4cb9192149e31b46cd9cf69b1e73b3a9404d13d1811e31a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:00.667 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:00 smithi162 bash[69446]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2 2024-09-19T08:54:01.166 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:00 smithi162 podman[69462]: 2024-09-19 08:54:00.767996617 +0000 UTC m=+0.683456012 container remove 03bd6494c31b1cdc4cb9192149e31b46cd9cf69b1e73b3a9404d13d1811e31a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:01.432 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:01 smithi162 podman[69554]: 2024-09-19 08:54:01.084456006 +0000 UTC m=+0.015873398 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:01.432 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:01 smithi162 podman[69554]: 2024-09-19 08:54:01.193813244 +0000 UTC m=+0.125230623 container create 143c37b06166fe1c3920c6923d64a3c255ae89bb54fb03deb6f90d9600ccfb2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T08:54:01.432 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:01 smithi162 podman[69554]: 2024-09-19 08:54:01.429533312 +0000 UTC m=+0.360950690 container init 143c37b06166fe1c3920c6923d64a3c255ae89bb54fb03deb6f90d9600ccfb2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-19T08:54:01.917 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:01 smithi162 podman[69554]: 2024-09-19 08:54:01.432974381 +0000 UTC m=+0.364391768 container start 143c37b06166fe1c3920c6923d64a3c255ae89bb54fb03deb6f90d9600ccfb2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T08:54:01.917 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:01 smithi162 podman[69554]: 2024-09-19 08:54:01.538354944 +0000 UTC m=+0.469772340 container attach 143c37b06166fe1c3920c6923d64a3c255ae89bb54fb03deb6f90d9600ccfb2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-19T08:54:01.917 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 08:54:01 smithi162 podman[69554]: 2024-09-19 08:54:01.62296324 +0000 UTC m=+0.554380621 container died 143c37b06166fe1c3920c6923d64a3c255ae89bb54fb03deb6f90d9600ccfb2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T08:54:02.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T08:54:02.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:02.371 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T08:54:02.371 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T08:54:02.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.3 2024-09-19T08:54:02.692 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:02 smithi018 systemd[1]: Stopping Ceph osd.3 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:02.943 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:02 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:54:02.691+0000 7fece314b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:02.944 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:02 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:54:02.691+0000 7fece314b640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-19T08:54:02.944 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:02 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:54:02.691+0000 7fece314b640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:04.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:04.604+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:05.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:05.591+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:05.939 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:05 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:54:05.573+0000 7fecdb759640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.299557+0000 front 2024-09-19T08:53:41.299667+0000 (oldest deadline 2024-09-19T08:54:04.799653+0000) 2024-09-19T08:54:06.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:05 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:05.939+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:06.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:05 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:05.908+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:06.901 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:06 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:54:06.563+0000 7fecdb759640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.299557+0000 front 2024-09-19T08:53:41.299667+0000 (oldest deadline 2024-09-19T08:54:04.799653+0000) 2024-09-19T08:54:06.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:06.638+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:06.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:06.488+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:07.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:06 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:06.901+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:07.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:06 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:06.926+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:07.538+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:07.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:07.657+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:07.944 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:07 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3[51606]: 2024-09-19T08:54:07.516+0000 7fecdb759640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.299557+0000 front 2024-09-19T08:53:41.299667+0000 (oldest deadline 2024-09-19T08:54:04.799653+0000) 2024-09-19T08:54:08.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:07 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:07.943+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:08.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:07 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:07.950+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:08.444 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:08 smithi018 podman[107973]: 2024-09-19 08:54:08.19013373 +0000 UTC m=+5.614555645 container died 3fa15c94e0fd0b2a0322e6d2b5e1f18560711defa9bd545832fdbfdb579cb0cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T08:54:08.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:08.636+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:08.544+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:08.960 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:08 smithi018 podman[107973]: 2024-09-19 08:54:08.701006323 +0000 UTC m=+6.125428234 container cleanup 3fa15c94e0fd0b2a0322e6d2b5e1f18560711defa9bd545832fdbfdb579cb0cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T08:54:08.960 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:08 smithi018 bash[107973]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3 2024-09-19T08:54:09.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:08 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:08.896+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:09.378 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:08 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:08.979+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:09.378 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:08 smithi018 podman[107988]: 2024-09-19 08:54:08.960961388 +0000 UTC m=+0.764047184 container remove 3fa15c94e0fd0b2a0322e6d2b5e1f18560711defa9bd545832fdbfdb579cb0cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T08:54:09.680 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:09 smithi018 podman[108078]: 2024-09-19 08:54:09.282024167 +0000 UTC m=+0.016369415 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:09.680 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:09 smithi018 podman[108078]: 2024-09-19 08:54:09.411805559 +0000 UTC m=+0.146150795 container create a02a28118b315c2daa83759ab8a46169f3478a74fa3b3f69767d86fa2f0073d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:54:09.681 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:09 smithi018 podman[108078]: 2024-09-19 08:54:09.681433811 +0000 UTC m=+0.415779053 container init a02a28118b315c2daa83759ab8a46169f3478a74fa3b3f69767d86fa2f0073d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:09.505+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:09.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:09.655+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:09.944 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:09 smithi018 podman[108078]: 2024-09-19 08:54:09.684890219 +0000 UTC m=+0.419235454 container start a02a28118b315c2daa83759ab8a46169f3478a74fa3b3f69767d86fa2f0073d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:09.944 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:09 smithi018 podman[108078]: 2024-09-19 08:54:09.78141438 +0000 UTC m=+0.515759628 container attach a02a28118b315c2daa83759ab8a46169f3478a74fa3b3f69767d86fa2f0073d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T08:54:09.944 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 08:54:09 smithi018 podman[108078]: 2024-09-19 08:54:09.877637053 +0000 UTC m=+0.611982289 container died a02a28118b315c2daa83759ab8a46169f3478a74fa3b3f69767d86fa2f0073d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T08:54:10.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:09 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:09.944+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:10.350 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:10 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:10.005+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:10.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T08:54:10.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:10.713 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T08:54:10.713 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T08:54:10.714 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.4 2024-09-19T08:54:10.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:10.705+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:10.511+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:11.050 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:10 smithi150 systemd[1]: Stopping Ceph osd.4 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:11.050 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:10 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:10.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:11.193 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:10 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:10.996+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:11.315 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:11 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:54:11.050+0000 7f0a21547640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:11.316 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:11 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:54:11.050+0000 7f0a21547640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-19T08:54:11.316 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:11 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:54:11.050+0000 7f0a21547640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:11.916 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:11.535+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:11.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:11.719+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:12.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:11 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:11.968+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:12.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:12 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:12.018+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:12.916 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:12 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:12.728+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:12.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:12 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:12.495+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:13.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:12 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:12.997+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:13.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:13 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:13.112+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:13.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:12 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:12.997+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:13.700 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:13 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:13.446+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:14.168 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:13 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:13.700+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:14.317 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:14 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:54:14.175+0000 7f0a1db5d640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.690813+0000 front 2024-09-19T08:53:50.690934+0000 (oldest deadline 2024-09-19T08:54:13.590953+0000) 2024-09-19T08:54:14.317 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:14 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:14.151+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:14.318 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:13 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:13.952+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:14.318 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:13 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:13.952+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:14.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:14 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:14.027+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:14.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:14 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:14.027+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:14.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:14 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:14.432+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:14.667 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:14 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:14.205+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:15.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:14 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:14.671+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:15.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:14 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:14.671+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:15.193 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:15 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:15.076+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:15.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:15 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:15.076+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:15.194 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:14 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:14.926+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:15.315 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:15 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4[45925]: 2024-09-19T08:54:15.215+0000 7f0a1db5d640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.690813+0000 front 2024-09-19T08:53:50.690934+0000 (oldest deadline 2024-09-19T08:54:13.590953+0000) 2024-09-19T08:54:15.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:15 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:15.200+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:15.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:14 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:14.988+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:15.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:14 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:14.988+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:15.479 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:15 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:15.174+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:15.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:15 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:15.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:15.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:15 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:15.704+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:15.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:15 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:15.704+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:16.194 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:15 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:15.934+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:16.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:16.034+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:16.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:16.034+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:16.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:16 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:16.158+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:16.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:15 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:15.940+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:16.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:15 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:15.940+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:16.465 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:16.186+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:16.784 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:16 smithi150 podman[68470]: 2024-09-19 08:54:16.499431623 +0000 UTC m=+5.578855340 container died bf6676c500c65ae103ca0beb47f69b33bb80bb77b1940891a052158b481c3f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T08:54:16.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:16.465+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:16.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:16.691+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:16.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:16 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:16.691+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:17.065 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:16 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:16.914+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:17.065 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:16 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:16.914+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:17.065 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:16 smithi150 podman[68470]: 2024-09-19 08:54:16.875732431 +0000 UTC m=+5.955156150 container cleanup bf6676c500c65ae103ca0beb47f69b33bb80bb77b1940891a052158b481c3f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:54:17.066 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:16 smithi150 bash[68470]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4 2024-09-19T08:54:17.194 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:16 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:16.942+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:17.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:17 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:17.084+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:17.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:17 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:17.084+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:17.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:17 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:17.157+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:17.492 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:17 smithi150 podman[68486]: 2024-09-19 08:54:17.152093831 +0000 UTC m=+0.649133974 container remove bf6676c500c65ae103ca0beb47f69b33bb80bb77b1940891a052158b481c3f82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:54:17.492 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:17 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:17.150+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:17.816 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:17 smithi150 podman[68577]: 2024-09-19 08:54:17.395245447 +0000 UTC m=+0.016394220 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:17.816 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:17 smithi150 podman[68577]: 2024-09-19 08:54:17.533798765 +0000 UTC m=+0.154947571 container create f9dae95b74c63a7252840d3fa1f51c9b24eff1b2f28d716e5ecad229868c690c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T08:54:17.816 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:17 smithi150 podman[68577]: 2024-09-19 08:54:17.814411597 +0000 UTC m=+0.435560361 container init f9dae95b74c63a7252840d3fa1f51c9b24eff1b2f28d716e5ecad229868c690c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T08:54:17.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:17 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:17.450+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:17.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:17 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:17.657+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:17.917 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:17 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:17.657+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:18.065 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:17 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:17.935+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:18.066 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:17 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:17.935+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:18.066 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:17 smithi150 podman[68577]: 2024-09-19 08:54:17.817709721 +0000 UTC m=+0.438858494 container start f9dae95b74c63a7252840d3fa1f51c9b24eff1b2f28d716e5ecad229868c690c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:18.066 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:17 smithi150 podman[68577]: 2024-09-19 08:54:17.889620734 +0000 UTC m=+0.510769498 container attach f9dae95b74c63a7252840d3fa1f51c9b24eff1b2f28d716e5ecad229868c690c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T08:54:18.066 INFO:journalctl@ceph.osd.4.smithi150.stdout:Sep 19 08:54:18 smithi150 podman[68577]: 2024-09-19 08:54:18.007125026 +0000 UTC m=+0.628273803 container died f9dae95b74c63a7252840d3fa1f51c9b24eff1b2f28d716e5ecad229868c690c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:54:18.416 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:18.163+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:18.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:17 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:17.992+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:18.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:18 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:18.100+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:18.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:18 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:18.100+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:18.565 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:18.121+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:18.722 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T08:54:18.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:18.764 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T08:54:18.764 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T08:54:18.764 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.5 2024-09-19T08:54:18.793 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:18.458+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:18.793 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:18.699+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:18.793 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:18 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:18.699+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:19.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:18 smithi162 systemd[1]: Stopping Ceph osd.5 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:19.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:19.148+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:19.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:18.952+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:19.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:18 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:18.952+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:19.410 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:19.169+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:19.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:19.085+0000 7fa95e921640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:19.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:19.085+0000 7fa95e921640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-19T08:54:19.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:19.085+0000 7fa95e921640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:19.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:18 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:18.952+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:19.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:19 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:19.067+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:19.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:19 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:19.067+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:19.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:19.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:20.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:19.723+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:20.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:19 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:19.723+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:20.175 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:19.921+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:20.175 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:19 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:19.921+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:20.411 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:20.121+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:20.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:19 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:19.955+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:20.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:20.095+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:20.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:20.095+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:20.565 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:20.174+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:20.666 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:20.411+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:21.162 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:20.744+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:21.162 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:20 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:20.744+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:21.194 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:20 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:20.941+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:21.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:21 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:21.103+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:21.194 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:21 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:21.103+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:21.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:21.159+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:21.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:21.159+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:21.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:20.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:21.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:20.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:21.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:20 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:20.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:21.416 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:21 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:21.365+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:21.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:21 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:21.162+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:22.137 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:21 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:21.722+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:22.137 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:21 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:21.722+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:22.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:22.163+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:22.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:22.163+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:22.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:21.971+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:22.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:21.971+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:22.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:21 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:21.971+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:22.395 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:22 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:22.137+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:22.395 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:22 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:22.137+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:22.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:21 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:21.951+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:22.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:22 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:22.151+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:22.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:22 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:22.151+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:22.666 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:22 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:22.395+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:22.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:22 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:22.395+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:23.155 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:22 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:22.749+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:23.155 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:22 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:22.749+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:23.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:23.160+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:23.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:23.160+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:23.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:22.947+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:23.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:22.947+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:23.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:22 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:22.947+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:23.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:23 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:23.155+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:23.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:23 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:23.155+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:23.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:23 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:23.401+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:23.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:23 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:23.401+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:23.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:23 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:23.130+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:23.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:23 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:23.130+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:23.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:22 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:22.989+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:23.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:22 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:22.989+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:24.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:23 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:23.760+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:39.106840+0000 front 2024-09-19T08:53:39.106861+0000 (oldest deadline 2024-09-19T08:54:03.806991+0000) 2024-09-19T08:54:24.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:23 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5[46514]: 2024-09-19T08:54:23.760+0000 7fa95af37640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.508050+0000 front 2024-09-19T08:53:48.508099+0000 (oldest deadline 2024-09-19T08:54:13.808104+0000) 2024-09-19T08:54:24.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:24 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:24.205+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:24.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:24 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:24.205+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:24.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:23.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:24.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:23.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:24.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:23 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:23.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:24.396 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:24 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:24.120+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:24.397 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:24 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:24.120+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:24.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:24 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:24.022+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:24.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:24 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:24.022+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:24.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:24 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:24.163+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:24.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:24 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:24.163+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:24.667 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:24 smithi162 podman[69668]: 2024-09-19 08:54:24.484622811 +0000 UTC m=+5.521256604 container died 261db353f8b265b7da3402c0c6c2eeb8a479ddb34e5af1d09b0c60386565475f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:54:24.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:24 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:24.396+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:24.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:24 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:24.396+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:25.152 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:24 smithi162 podman[69668]: 2024-09-19 08:54:24.926678918 +0000 UTC m=+5.963312699 container cleanup 261db353f8b265b7da3402c0c6c2eeb8a479ddb34e5af1d09b0c60386565475f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:25.152 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:24 smithi162 bash[69668]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5 2024-09-19T08:54:25.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:25 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:25.189+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:25.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:25 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:25.189+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:25.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:24 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:24.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:25.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:24 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:24.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:25.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:24 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:24.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:25.417 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:25 smithi162 podman[69686]: 2024-09-19 08:54:25.152974347 +0000 UTC m=+0.665398190 container remove 261db353f8b265b7da3402c0c6c2eeb8a479ddb34e5af1d09b0c60386565475f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:25.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:25 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:25.155+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:25.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:25 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:25.155+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:25.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:25 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:25.015+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:25.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:25 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:25.015+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:25.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:25 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:25.177+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:25.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:25 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:25.177+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:25.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:25 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:25.177+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:25.777 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:25 smithi162 podman[69778]: 2024-09-19 08:54:25.496375807 +0000 UTC m=+0.016231435 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:25.777 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:25 smithi162 podman[69778]: 2024-09-19 08:54:25.645844325 +0000 UTC m=+0.165699949 container create 7dcd583a41e7fda24dd0e62ddca5332574151886faf90cc8727012b385492ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:25.778 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:25 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:25.427+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:25.778 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:25 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:25.427+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:26.079 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:25 smithi162 podman[69778]: 2024-09-19 08:54:25.889852478 +0000 UTC m=+0.409708114 container init 7dcd583a41e7fda24dd0e62ddca5332574151886faf90cc8727012b385492ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T08:54:26.079 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:25 smithi162 podman[69778]: 2024-09-19 08:54:25.893247055 +0000 UTC m=+0.413102680 container start 7dcd583a41e7fda24dd0e62ddca5332574151886faf90cc8727012b385492ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T08:54:26.079 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:25 smithi162 podman[69778]: 2024-09-19 08:54:25.989983378 +0000 UTC m=+0.509839020 container attach 7dcd583a41e7fda24dd0e62ddca5332574151886faf90cc8727012b385492ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T08:54:26.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:26 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:26.173+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:26.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:26 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:26.173+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:26.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:25 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:25.985+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:26.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:25 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:25.985+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:26.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:25 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:25.985+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:26.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 08:54:26 smithi162 podman[69800]: 2024-09-19 08:54:26.108815384 +0000 UTC m=+0.016800551 container died 7dcd583a41e7fda24dd0e62ddca5332574151886faf90cc8727012b385492ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T08:54:26.384 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:26 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:26.148+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:26.384 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:26 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:26.148+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:26.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:26 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:26.017+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:26.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:26 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:26.017+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:26.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:26 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:26.219+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:26.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:26 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:26.219+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:26.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:26 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:26.219+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:26.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:26 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:26.403+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:26.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:26 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:26.403+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:26.739 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T08:54:26.817 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:26.817 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T08:54:26.817 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T08:54:26.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.6 2024-09-19T08:54:27.129 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:26 smithi018 systemd[1]: Stopping Ceph osd.6 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:27.129 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:27.002+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:27.129 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:27.002+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:27.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:27 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:27.173+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:27.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:27 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:27.173+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:27.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:26 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:26.971+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:27.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:26 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:26.971+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:27.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:26 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:26.971+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:27.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:27 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:27.122+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:27.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:27 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:27.122+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:27.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:27.129+0000 7f12a5641640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:27.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:27.129+0000 7f12a5641640 -1 osd.6 94 *** Got signal Terminated *** 2024-09-19T08:54:27.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:27.129+0000 7f12a5641640 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:27.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:27.185+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:27.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:27.185+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:27.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:27.185+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:27.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:27 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:27.441+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:27.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:27 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:27.441+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:28.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:28 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:28.150+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:28.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:28 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:28.150+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:28.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:27 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:27.938+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:28.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:27 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:27.938+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:28.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:27 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:27.938+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:28.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:28 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:28.087+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:28.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:28 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:28.087+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:28.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:28 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:28.047+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:28.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:28 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:28.047+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:28.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:28 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:28.229+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:28.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:28 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:28.229+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:28.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:28 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:28.229+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:28.916 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:28 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:28.429+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:28.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:28 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:28.429+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:29.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:29 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:29.181+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:29.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:29 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:29.182+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:29.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:28 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:28.987+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:29.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:28 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:28.987+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:29.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:28 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:28.987+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:29.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:28 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:28.987+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:29.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:29 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:29.109+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:29.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:29 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:29.109+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:29.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:29 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:29.083+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:29.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:29 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:29.083+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:29.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:29 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:29.083+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.599987+0000 front 2024-09-19T08:54:04.600042+0000 (oldest deadline 2024-09-19T08:54:28.700194+0000) 2024-09-19T08:54:29.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:29 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:29.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:29.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:29 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:29.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:29.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:29 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:29.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:29.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:29 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:29.422+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:29.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:29 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:29.422+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:30.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:30.163+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:30.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:30.163+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:30.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:30.008+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:30.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:30.008+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:30.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:30.008+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:30.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:30.008+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:30.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:30.088+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:30.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:30.088+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:30.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:30.088+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:30.076+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:30.076+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:30.076+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.599987+0000 front 2024-09-19T08:54:04.600042+0000 (oldest deadline 2024-09-19T08:54:28.700194+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:30.226+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:30.226+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:30.226+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:30.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:30 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:30.226+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:30.692 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:30.444+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:30.692 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:30.444+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:30.693 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:30 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:30.444+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:31.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:31.159+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:31.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:31.159+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:31.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:31.159+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:31.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:31.046+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:31.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:31.046+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:31.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:31.046+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:31.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:31 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:31.046+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:31.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:31.087+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:31.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:31.087+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:31.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:31.087+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:31.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:31.105+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:31.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:31.105+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:31.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:31.105+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.599987+0000 front 2024-09-19T08:54:04.600042+0000 (oldest deadline 2024-09-19T08:54:28.700194+0000) 2024-09-19T08:54:31.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:31.194+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:31.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:31.194+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:31.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:31.194+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:31.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:31 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:31.194+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:31.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:31.488+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:31.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:31.488+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:31.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:31 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:31.488+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:32.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:32.139+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:32.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:32.139+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:32.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:32.139+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:32.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:32.044+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:32.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:32.044+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:32.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:32.044+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:32.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:32 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:32.044+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:32.416 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:32.104+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:32.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:32.104+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:32.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:32.104+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:32.115+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.697332+0000 front 2024-09-19T08:53:50.697438+0000 (oldest deadline 2024-09-19T08:54:14.098095+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:32.115+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.098757+0000 front 2024-09-19T08:53:54.098781+0000 (oldest deadline 2024-09-19T08:54:22.898997+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6[58071]: 2024-09-19T08:54:32.115+0000 7f129dc4f640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.599987+0000 front 2024-09-19T08:54:04.600042+0000 (oldest deadline 2024-09-19T08:54:28.700194+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:32.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:32.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:32.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:32.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:32 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:32.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:32.804 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:32 smithi018 podman[108193]: 2024-09-19 08:54:32.504576504 +0000 UTC m=+5.485364742 container died 5c08628281714fbb54246ee469bd47870e6788ea2f1ce7b71efc0bca055cf9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:54:32.916 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:32.478+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:32.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:32.478+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:32.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:32 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:32.478+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:33.194 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 podman[108193]: 2024-09-19 08:54:33.020971524 +0000 UTC m=+6.001759762 container cleanup 5c08628281714fbb54246ee469bd47870e6788ea2f1ce7b71efc0bca055cf9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:33.194 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 bash[108193]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6 2024-09-19T08:54:33.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:33.172+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:33.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:33.172+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:33.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:33.172+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:33.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.013+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:33.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.013+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:33.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.013+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:33.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.013+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:33.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:33.105+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:33.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:33.106+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:33.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:33.106+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:33.694 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 podman[108208]: 2024-09-19 08:54:33.25581846 +0000 UTC m=+0.748759000 container remove 5c08628281714fbb54246ee469bd47870e6788ea2f1ce7b71efc0bca055cf9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:33.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:33 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:33.228+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:33.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:33 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:33.228+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:33.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:33 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:33.228+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:33.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:33 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:33.228+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:33.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:33.429+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:33.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:33.429+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:33.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:33 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:33.429+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:33.983 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 podman[108298]: 2024-09-19 08:54:33.606259594 +0000 UTC m=+0.016410439 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:33.983 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 podman[108298]: 2024-09-19 08:54:33.731645659 +0000 UTC m=+0.141796490 container create 53021e191919158d2fa3cc380a9ede53317a1a001d271eb6b243c52f133c978e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T08:54:33.984 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 podman[108298]: 2024-09-19 08:54:33.984090446 +0000 UTC m=+0.394241276 container init 53021e191919158d2fa3cc380a9ede53317a1a001d271eb6b243c52f133c978e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:34.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:34.177+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:34.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:34.177+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:34.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:34.177+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:34.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.991+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:34.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.991+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:34.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.991+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:34.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:33.991+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:34.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:34 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:34.138+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:34.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:34 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:34.138+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:34.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:34 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:34.138+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:34.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:34.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:34.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:34.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:34.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:34.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:34.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:34 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:34.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:34.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:33 smithi018 podman[108298]: 2024-09-19 08:54:33.987645482 +0000 UTC m=+0.397796316 container start 53021e191919158d2fa3cc380a9ede53317a1a001d271eb6b243c52f133c978e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T08:54:34.444 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:34 smithi018 podman[108298]: 2024-09-19 08:54:34.059152415 +0000 UTC m=+0.469303262 container attach 53021e191919158d2fa3cc380a9ede53317a1a001d271eb6b243c52f133c978e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T08:54:34.445 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:34 smithi018 podman[108298]: 2024-09-19 08:54:34.178157684 +0000 UTC m=+0.588308530 container died 53021e191919158d2fa3cc380a9ede53317a1a001d271eb6b243c52f133c978e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:34.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:34 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:34.454+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:34.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:34 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:34.454+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:34.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:34 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:34.454+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:34.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T08:54:34.984 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:34 smithi018 podman[108321]: 2024-09-19 08:54:34.929876729 +0000 UTC m=+0.741597783 container remove 53021e191919158d2fa3cc380a9ede53317a1a001d271eb6b243c52f133c978e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:34.984 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:34 smithi018 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.6.service: Deactivated successfully. 2024-09-19T08:54:34.984 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:34 smithi018 systemd[1]: Stopped Ceph osd.6 for ed3de594-7661-11ef-bceb-c7b262605968. 2024-09-19T08:54:34.984 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 08:54:34 smithi018 systemd[1]: ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.6.service: Consumed 3min 19.727s CPU time. 2024-09-19T08:54:34.999 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:34.999 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T08:54:34.999 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T08:54:34.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.7 2024-09-19T08:54:35.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 systemd[1]: Stopping Ceph osd.7 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:35.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:35.158+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:35.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:35.158+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:35.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:35.158+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:35.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:34.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:35.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:34.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:35.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:34.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:35.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:34 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:34.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:35.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:35 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:35.137+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:35.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:35 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:35.137+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:35.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:35 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:35.137+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:35.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:35 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:35.137+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:35.496 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:35 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:35.175+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:35.496 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:35 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:35.175+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:35.496 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:35 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:35.175+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:35.697 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:35.329+0000 7f10cd001640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:35.697 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:35.330+0000 7f10cd001640 -1 osd.7 94 *** Got signal Terminated *** 2024-09-19T08:54:35.697 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:35.330+0000 7f10cd001640 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:35.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:35 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:35.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:35.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:35 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:35.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:35.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:35 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:35.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:36.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:35.949+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:36.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:35.949+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:36.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:35.949+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:36.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:35 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:35.949+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:36.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:36.120+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:36.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:36.120+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:36.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:36.120+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:36.416 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:36 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:36.141+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:36.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:36 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:36.141+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:36.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:36 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:36.141+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:36.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:36 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:36.139+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:36.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:36 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:36.139+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:36.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:36 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:36.139+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:36.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:36 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:36.139+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:36.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:36 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:36.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:36.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:36 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:36.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:36.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:36 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:36.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:37.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:37.157+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:37.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:37.157+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:37.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:37.157+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:37.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:36.939+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:37.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:36.939+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:37.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:36.939+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:37.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:36 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:36.939+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:37.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:37.119+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:37.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:37.119+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:37.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:37.119+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:37.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:37 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:37.144+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:37.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:37 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:37.144+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:37.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:37 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:37.144+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:37.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:37 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:37.144+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:37.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:37.476+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:37.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:37.476+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:37.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:37.476+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:37.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:37 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:37.476+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:38.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:38.144+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:38.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:38.144+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:38.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:38.144+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:38.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:37.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:38.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:37.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:38.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:37.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:38.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:37.964+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:38.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:38.074+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:38.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:38.074+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:38.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:38.074+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:38.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:38.154+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:38.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:38.154+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:38.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:38.154+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:38.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:38 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:38.154+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:38.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:38.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:38.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:38.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:38.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:38.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:38.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:38 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:38.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:39.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:39.098+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:39.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:39.098+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:39.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:39.098+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:39.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:38.968+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:39.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:38.968+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:39.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:38.968+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:39.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:38 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:38.968+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:39.391 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:39.069+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:39.391 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:39.069+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:39.391 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:39.069+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:39.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:39.120+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:39.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:39.120+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:39.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:39.120+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:39.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:39.120+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:39.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:39 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:39.120+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:39.666 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:39.391+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:39.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:39.391+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:39.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:39.391+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:39.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:39 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:39.391+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:40.315 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:40.068+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.026605+0000 front 2024-09-19T08:53:48.026456+0000 (oldest deadline 2024-09-19T08:54:12.726312+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:40.068+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:54.427517+0000 front 2024-09-19T08:53:54.427430+0000 (oldest deadline 2024-09-19T08:54:20.327468+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7[52433]: 2024-09-19T08:54:40.068+0000 7f10c560f640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.329405+0000 front 2024-09-19T08:54:07.329428+0000 (oldest deadline 2024-09-19T08:54:30.829364+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:39.965+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:39.965+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:39.965+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:39.965+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:40.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:39 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:39.965+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:40.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:40.028+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:40.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:40.028+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:40.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:40.028+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:40.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:40.028+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:40.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:40.166+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:40.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:40.166+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:40.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:40.166+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:40.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:40.166+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:40.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:40 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:40.166+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:40.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:40.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:40.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:40.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:40.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:40.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:40.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:40 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:40.439+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:41.147 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:40 smithi150 podman[68681]: 2024-09-19 08:54:40.851051237 +0000 UTC m=+5.646885528 container died 56712fb5dbfa500fce955f01d4fbfe9769ade5a2fa3abecd78a50a1072240a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:41.147 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:40.962+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:41.148 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:40.962+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:41.148 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:40.962+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:41.148 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:40.962+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:41.148 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:40 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:40.962+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:41.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:41.030+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:41.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:41.030+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:41.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:41.030+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:41.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:41.030+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:41.493 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:41 smithi150 podman[68681]: 2024-09-19 08:54:41.246935878 +0000 UTC m=+6.042770171 container cleanup 56712fb5dbfa500fce955f01d4fbfe9769ade5a2fa3abecd78a50a1072240a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T08:54:41.493 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:41 smithi150 bash[68681]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7 2024-09-19T08:54:41.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:41.211+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:41.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:41.211+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:41.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:41.211+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:41.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:41.211+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:41.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:41 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:41.211+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:41.740 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:41.475+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:41.741 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:41.475+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:41.741 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:41.475+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:41.741 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:41 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:41.475+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:41.804 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:41 smithi150 podman[68708]: 2024-09-19 08:54:41.49394338 +0000 UTC m=+0.637355121 container remove 56712fb5dbfa500fce955f01d4fbfe9769ade5a2fa3abecd78a50a1072240a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T08:54:42.065 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:41 smithi150 podman[68798]: 2024-09-19 08:54:41.707630941 +0000 UTC m=+0.015974271 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:42.065 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:41 smithi150 podman[68798]: 2024-09-19 08:54:41.840947766 +0000 UTC m=+0.149291122 container create 885d32329a0b0bf9830f457300176a5410d54667188cc39ab0ff8ccb4acde423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T08:54:42.066 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:41.972+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:42.066 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:41.972+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:42.066 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:41.972+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:42.066 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:41.972+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:42.066 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:41.972+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:42.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:42.051+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:42.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:42.051+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:42.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:42.051+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:42.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:42.051+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:42.566 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:42 smithi150 podman[68798]: 2024-09-19 08:54:42.091650089 +0000 UTC m=+0.399993407 container init 885d32329a0b0bf9830f457300176a5410d54667188cc39ab0ff8ccb4acde423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:42.566 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:42 smithi150 podman[68798]: 2024-09-19 08:54:42.094831776 +0000 UTC m=+0.403175099 container start 885d32329a0b0bf9830f457300176a5410d54667188cc39ab0ff8ccb4acde423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T08:54:42.566 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:42 smithi150 podman[68798]: 2024-09-19 08:54:42.193779671 +0000 UTC m=+0.502122996 container attach 885d32329a0b0bf9830f457300176a5410d54667188cc39ab0ff8ccb4acde423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:54:42.566 INFO:journalctl@ceph.osd.7.smithi150.stdout:Sep 19 08:54:42 smithi150 podman[68798]: 2024-09-19 08:54:42.28840288 +0000 UTC m=+0.596746202 container died 885d32329a0b0bf9830f457300176a5410d54667188cc39ab0ff8ccb4acde423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:42.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:42.225+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:42.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:42.225+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:42.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:42.225+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:42.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:42.225+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:42.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:42 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:42.225+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:42.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:42.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:42.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:42.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:42.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:42.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:42.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:42 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:42.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:42.927 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T08:54:42.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:42.968 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T08:54:42.968 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T08:54:42.969 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.8 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 systemd[1]: Stopping Ceph osd.8 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.085+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.085+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.085+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.085+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.287+0000 7f638d72d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:43.287 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.287+0000 7f638d72d640 -1 osd.8 94 *** Got signal Terminated *** 2024-09-19T08:54:43.288 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:43.287+0000 7f638d72d640 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:43.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.000+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:43.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.000+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:43.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.000+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:43.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.000+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:43.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.000+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:43.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:43.469+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:43.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:43.469+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:43.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:43.469+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:43.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:43 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:43.469+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:43.693 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:43 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:43.258+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:43.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:43 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:43.258+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:43.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:43 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:43.258+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:43.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:43 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:43.258+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:43.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:43 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:43.258+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:44.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.990+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:44.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.990+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:44.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.990+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:44.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.990+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:44.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:43 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:43.990+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:44.416 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:44.055+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:44.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:44.055+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:44.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:44.055+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:44.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:44.055+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:44.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:44 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:44.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:44.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:44 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:44.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:44.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:44 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:44.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:44.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:44 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:44.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:44.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:44 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:44.274+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:44.916 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:44.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:44.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:44.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:44.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:44.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:44.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:44 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:44.496+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:45.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:44 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:44.970+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:45.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:44 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:44.970+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:45.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:44 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:44.970+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:45.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:44 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:44.970+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:45.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:44 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:44.970+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:45.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:45.010+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:45.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:45.010+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:45.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:45.010+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:45.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:45.010+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:45.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:45 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:45.243+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:45.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:45 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:45.243+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:45.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:45 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:45.243+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:45.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:45 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:45.243+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:45.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:45 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:45.243+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:45.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:45.503+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:45.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:45.503+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:45.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:45.503+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:45.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:45.503+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:45.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:45 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:45.503+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:46.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:45 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:45.975+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:46.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:45 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:45.975+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:46.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:45 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:45.975+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:46.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:45 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:45.975+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:46.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:45 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:45.975+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:46.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:46.013+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:46.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:46.013+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:46.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:46.013+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:46.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:46.013+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:46.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:46 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:46.281+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:46.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:46 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:46.281+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:46.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:46 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:46.281+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:46.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:46 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:46.281+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:46.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:46 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:46.281+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:46.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:46 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:46.281+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:46.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:46.461+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:46.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:46.461+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:46.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:46.461+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:46.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:46.461+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:46.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:46.461+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:47.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:46.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:47.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:46.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:47.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:46.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:47.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:46.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:47.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:46 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:46.973+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:47.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:47.043+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:47.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:47.043+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:47.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:47.043+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:47.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:47.043+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:47.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:47 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:47.251+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:47.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:47 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:47.251+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:47.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:47 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:47.251+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:47.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:47 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:47.251+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:47.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:47 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:47.251+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:47.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:47 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:47.251+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:47.916 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:47.459+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:47.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:47.459+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:47.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:47.459+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:47.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:47.459+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:47.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:47 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:47.459+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:48.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.009+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:48.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.009+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:48.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.009+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:48.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.009+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:48.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.009+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:48.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:48.052+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:49.665122+0000 front 2024-09-19T08:53:49.665105+0000 (oldest deadline 2024-09-19T08:54:13.765010+0000) 2024-09-19T08:54:48.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:48.052+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.867229+0000 front 2024-09-19T08:53:58.867200+0000 (oldest deadline 2024-09-19T08:54:21.767386+0000) 2024-09-19T08:54:48.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:48.052+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.668573+0000 front 2024-09-19T08:54:04.668652+0000 (oldest deadline 2024-09-19T08:54:29.968392+0000) 2024-09-19T08:54:48.417 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8[53413]: 2024-09-19T08:54:48.052+0000 7f6385d3b640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.370034+0000 front 2024-09-19T08:54:13.369973+0000 (oldest deadline 2024-09-19T08:54:39.269809+0000) 2024-09-19T08:54:48.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:48.216+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:48.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:48.216+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:48.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:48.216+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:48.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:48.216+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:48.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:48.216+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:48.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:48 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:48.216+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:48.917 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:48 smithi162 podman[69891]: 2024-09-19 08:54:48.647585464 +0000 UTC m=+5.482033551 container died cafe214cce393440c523740adf6fe2d4a4656af02e2beb09f2d9f5da3b3d4908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T08:54:48.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:48.435+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:48.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:48.435+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:48.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:48.435+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:48.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:48.435+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:48.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:48 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:48.435+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:49.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:49.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:49.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:49.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:49.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:49.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:48 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:48.976+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:49.403 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:49 smithi162 podman[69891]: 2024-09-19 08:54:49.144770484 +0000 UTC m=+5.979218557 container cleanup cafe214cce393440c523740adf6fe2d4a4656af02e2beb09f2d9f5da3b3d4908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:49.404 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:49 smithi162 bash[69891]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8 2024-09-19T08:54:49.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:49.180+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:49.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:49.180+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:49.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:49.180+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:49.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:49.180+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:49.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:49.180+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:49.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:49 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:49.180+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:49.666 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:49 smithi162 podman[69909]: 2024-09-19 08:54:49.404519734 +0000 UTC m=+0.752480290 container remove cafe214cce393440c523740adf6fe2d4a4656af02e2beb09f2d9f5da3b3d4908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T08:54:49.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:49 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:49.406+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:49.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:49 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:49.406+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:49.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:49 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:49.406+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:49.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:49 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:49.406+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:49.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:49 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:49.406+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:50.015 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:49 smithi162 podman[69996]: 2024-09-19 08:54:49.667490205 +0000 UTC m=+0.015913525 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:50.015 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:49 smithi162 podman[69996]: 2024-09-19 08:54:49.789994435 +0000 UTC m=+0.138417756 container create 1954113e5e9f51c8a699ee03689517da981b558a7ce3829dbfcf678221ead4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T08:54:50.281 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:50 smithi162 podman[69996]: 2024-09-19 08:54:50.016261174 +0000 UTC m=+0.364684494 container init 1954113e5e9f51c8a699ee03689517da981b558a7ce3829dbfcf678221ead4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T08:54:50.281 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:50 smithi162 podman[69996]: 2024-09-19 08:54:50.020233971 +0000 UTC m=+0.368657294 container start 1954113e5e9f51c8a699ee03689517da981b558a7ce3829dbfcf678221ead4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:54:50.281 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:50 smithi162 podman[69996]: 2024-09-19 08:54:50.116265325 +0000 UTC m=+0.464688662 container attach 1954113e5e9f51c8a699ee03689517da981b558a7ce3829dbfcf678221ead4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:54:50.282 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 08:54:50 smithi162 podman[69996]: 2024-09-19 08:54:50.223618265 +0000 UTC m=+0.572041586 container died 1954113e5e9f51c8a699ee03689517da981b558a7ce3829dbfcf678221ead4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:50.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.022+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:50.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.022+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:50.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.022+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:50.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.022+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:50.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.022+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:50.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.022+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:50.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:50.455+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:50.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:50.455+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:50.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:50.455+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:50.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:50.455+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:50.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:50.455+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:50.693 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:50.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:50.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:50.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:50.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:50.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:50.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:50.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:50.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:50.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:50.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:50.203+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:50.838 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T08:54:50.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:50.877 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T08:54:50.877 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T08:54:50.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.9 2024-09-19T08:54:51.190 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:50 smithi018 systemd[1]: Stopping Ceph osd.9 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:51.190 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.190+0000 7f3577f7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:51.190 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.190+0000 7f3577f7d640 -1 osd.9 94 *** Got signal Terminated *** 2024-09-19T08:54:51.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:51.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:51.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:51.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:51.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:51.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:50 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:50.992+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.190+0000 7f3577f7d640 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.200+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.200+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.200+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.200+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.200+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:51.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:51 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:51.200+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:51.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:51 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:51.473+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:51.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:51 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:51.473+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:51.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:51 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:51.473+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:51.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:51 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:51.473+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:51.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:51 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:51.473+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:52.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:52 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:52.039+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:52.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:52 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:52.039+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:52.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:52 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:52.039+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:52.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:52 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:52.039+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:52.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:52 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:52.039+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:52.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:52 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:52.039+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:52.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:52.196+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:52.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:52.196+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:52.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:52.196+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:52.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:52.196+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:52.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:52.196+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:52.694 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:52 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:52.196+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:52.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:52 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:52.487+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:52.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:52 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:52.487+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:52.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:52 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:52.487+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:52.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:52 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:52.487+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:52.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:52 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:52.487+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:53.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:53.066+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:53.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:53.066+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:53.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:53.066+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:53.315 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:53.066+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:53.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:53.066+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:53.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:53 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:53.066+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:53.443 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:53.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:53.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:53.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:53.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:53.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:53.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:53.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:53.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:53.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:53.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:53 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:53.186+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:53.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:53 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:53.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:53.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:53 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:53.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:53.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:53 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:53.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:53.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:53 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:53.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:53.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:53 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:53.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:53.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:53 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:53.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:54:54.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:54 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:54.146+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:54.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:54 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:54.146+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:54.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:54 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:54.146+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:54.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:54 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:54.146+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:54.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:54 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:54.146+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:54.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:54 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:54.146+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:54.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:54.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:54.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:54.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:54.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:54.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:54.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:54 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:54.081+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:54:54.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:54.451+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:54.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:54.451+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:54.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:54.451+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:54.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:54.451+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:54.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:54.451+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:54.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:54 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:54.451+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:54:55.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:55.153+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:42.266382+0000 front 2024-09-19T08:53:42.266405+0000 (oldest deadline 2024-09-19T08:54:05.166571+0000) 2024-09-19T08:54:55.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:55.153+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:48.067673+0000 front 2024-09-19T08:53:48.067883+0000 (oldest deadline 2024-09-19T08:54:13.967752+0000) 2024-09-19T08:54:55.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:55.153+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.871251+0000 front 2024-09-19T08:53:58.871054+0000 (oldest deadline 2024-09-19T08:54:24.771261+0000) 2024-09-19T08:54:55.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:55.153+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:04.771613+0000 front 2024-09-19T08:54:04.771628+0000 (oldest deadline 2024-09-19T08:54:29.471728+0000) 2024-09-19T08:54:55.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:55.153+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:13.572852+0000 front 2024-09-19T08:54:13.572693+0000 (oldest deadline 2024-09-19T08:54:38.272595+0000) 2024-09-19T08:54:55.444 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:55 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9[64726]: 2024-09-19T08:54:55.153+0000 7f357058b640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:22.973836+0000 front 2024-09-19T08:54:22.973785+0000 (oldest deadline 2024-09-19T08:54:45.273605+0000) 2024-09-19T08:54:55.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:55.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:55.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:55.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:55.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:55.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:55.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:55 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:55.113+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:54:55.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:55.464+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:55.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:55.464+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:55.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:55.464+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:55.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:55.464+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:55.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:55.464+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:55.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:55.464+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:54:56.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:56.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:56.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:56.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:56.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:56.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:56.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:56 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:56.078+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:54:56.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:56 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:56.420+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:56.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:56 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:56.420+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:56.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:56 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:56.420+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:56.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:56 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:56.420+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:56.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:56 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:56.420+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:56.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:56 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:56.420+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:54:57.014 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:56 smithi018 podman[108412]: 2024-09-19 08:54:56.745150142 +0000 UTC m=+5.657388168 container died 96c6d03e81a3caeed7d115aeb5cc265d8ac924a39d4dd45dc8e629af86dd4932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:57.372 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:57 smithi018 podman[108412]: 2024-09-19 08:54:57.122629532 +0000 UTC m=+6.034867555 container cleanup 96c6d03e81a3caeed7d115aeb5cc265d8ac924a39d4dd45dc8e629af86dd4932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:54:57.373 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:57 smithi018 bash[108412]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9 2024-09-19T08:54:57.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:57.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:57.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:57.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:57.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:57.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:57.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:57 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:57.111+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:54:57.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:57 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:57.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:57.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:57 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:57.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:57.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:57 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:57.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:57.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:57 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:57.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:57.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:57 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:57.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:57.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:57 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:57.410+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:54:57.693 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:57 smithi018 podman[108427]: 2024-09-19 08:54:57.373739756 +0000 UTC m=+0.623393662 container remove 96c6d03e81a3caeed7d115aeb5cc265d8ac924a39d4dd45dc8e629af86dd4932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:54:57.962 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:57 smithi018 podman[108513]: 2024-09-19 08:54:57.600354603 +0000 UTC m=+0.016240422 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:57.962 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:57 smithi018 podman[108513]: 2024-09-19 08:54:57.69973471 +0000 UTC m=+0.115620533 container create 3a09db03a3e96cd762ef0f1b30b9ebddb6cc20c08536be2b9c0b52874cf2ed30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:58.257 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:58 smithi018 podman[108513]: 2024-09-19 08:54:58.060521551 +0000 UTC m=+0.476407379 container init 3a09db03a3e96cd762ef0f1b30b9ebddb6cc20c08536be2b9c0b52874cf2ed30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:54:58.257 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:58 smithi018 podman[108513]: 2024-09-19 08:54:58.064145222 +0000 UTC m=+0.480031041 container start 3a09db03a3e96cd762ef0f1b30b9ebddb6cc20c08536be2b9c0b52874cf2ed30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T08:54:58.257 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:58 smithi018 podman[108513]: 2024-09-19 08:54:58.143772828 +0000 UTC m=+0.559658657 container attach 3a09db03a3e96cd762ef0f1b30b9ebddb6cc20c08536be2b9c0b52874cf2ed30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T08:54:58.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.141+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:58.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.141+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:58.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.141+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:58.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.141+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:58.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.141+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:58.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.142+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:58.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:58 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:58.142+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:54:58.612 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 08:54:58 smithi018 podman[108513]: 2024-09-19 08:54:58.25799384 +0000 UTC m=+0.673879661 container died 3a09db03a3e96cd762ef0f1b30b9ebddb6cc20c08536be2b9c0b52874cf2ed30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:54:58.916 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:58.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:58.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:58.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:58.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:58.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:58.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:58.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:58.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:58.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:58.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:58.449+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:54:58.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T08:54:58.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:54:58.965 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T08:54:58.966 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T08:54:58.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.10 2024-09-19T08:54:59.284 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 systemd[1]: Stopping Ceph osd.10 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:54:59.284 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:54:59.284 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:54:59.284 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.168+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.284+0000 7f1474b56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.284+0000 7f1474b56640 -1 osd.10 94 *** Got signal Terminated *** 2024-09-19T08:54:59.285 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:54:59 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:54:59.284+0000 7f1474b56640 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:54:59.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:59 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:59.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:54:59.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:59 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:59.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:54:59.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:59 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:59.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:54:59.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:59 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:59.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:54:59.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:59 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:59.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:54:59.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:54:59 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:54:59.448+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:00.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:55:00.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:55:00.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:55:00.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:55:00.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:55:00.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:55:00.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:00 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:00.134+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:55:00.760 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:00 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:00.445+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:00.761 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:00 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:00.445+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:00.761 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:00 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:00.445+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:00.761 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:00 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:00.445+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:00.761 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:00 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:00.445+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:00.761 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:00 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:00.445+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:01.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:55:01.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:55:01.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:55:01.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:55:01.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:55:01.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:55:01.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:01 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:01.118+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:55:01.666 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:01 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:01.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:01.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:01 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:01.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:01.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:01 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:01.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:01.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:01 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:01.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:01.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:01 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:01.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:01.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:01 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:01.479+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:02.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:55:02.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:55:02.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:55:02.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:55:02.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:55:02.567 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:55:02.567 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:02 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:02.085+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:02.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:02 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:02.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:03.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:55:03.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:55:03.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:55:03.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:55:03.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:55:03.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:55:03.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:03 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:03.098+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:55:03.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:03.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:03.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:03.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:03.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:03.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:03.918 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:03 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:03.510+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:04.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.333867+0000 front 2024-09-19T08:53:41.333811+0000 (oldest deadline 2024-09-19T08:54:05.433957+0000) 2024-09-19T08:55:04.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-09-19T08:53:50.734888+0000 front 2024-09-19T08:53:50.734825+0000 (oldest deadline 2024-09-19T08:54:13.535624+0000) 2024-09-19T08:55:04.565 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:59.337180+0000 front 2024-09-19T08:53:59.337373+0000 (oldest deadline 2024-09-19T08:54:20.437203+0000) 2024-09-19T08:55:04.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:07.438657+0000 front 2024-09-19T08:54:07.438617+0000 (oldest deadline 2024-09-19T08:54:28.538535+0000) 2024-09-19T08:55:04.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.339773+0000 front 2024-09-19T08:54:14.339730+0000 (oldest deadline 2024-09-19T08:54:39.039879+0000) 2024-09-19T08:55:04.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:23.141048+0000 front 2024-09-19T08:54:23.140870+0000 (oldest deadline 2024-09-19T08:54:48.440713+0000) 2024-09-19T08:55:04.566 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10[58971]: 2024-09-19T08:55:04.109+0000 7f146d164640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:28.441311+0000 front 2024-09-19T08:54:28.441370+0000 (oldest deadline 2024-09-19T08:54:53.741099+0000) 2024-09-19T08:55:04.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:04.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:04.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:04.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:04.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:04.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:04.918 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:04 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:04.529+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:05.110 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:04 smithi150 podman[68901]: 2024-09-19 08:55:04.834190723 +0000 UTC m=+5.674531239 container died 6d1be801bb1c42a5c153f4f9886cdef825d91510f29413e96be1a83efce6d0c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T08:55:05.442 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 podman[68901]: 2024-09-19 08:55:05.217222699 +0000 UTC m=+6.057563214 container cleanup 6d1be801bb1c42a5c153f4f9886cdef825d91510f29413e96be1a83efce6d0c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T08:55:05.442 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 bash[68901]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10 2024-09-19T08:55:05.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 podman[68916]: 2024-09-19 08:55:05.443380701 +0000 UTC m=+0.611608868 container remove 6d1be801bb1c42a5c153f4f9886cdef825d91510f29413e96be1a83efce6d0c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:05.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:05 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:05.482+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:06.054 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 podman[69006]: 2024-09-19 08:55:05.769272813 +0000 UTC m=+0.104344965 container create 0f91a3d1a348cd412ea4a95ea1711363ce15163a407918b666f2d5296ce07574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:55:06.054 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 podman[69006]: 2024-09-19 08:55:05.680612547 +0000 UTC m=+0.015684650 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:55:06.054 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 podman[69006]: 2024-09-19 08:55:05.971663269 +0000 UTC m=+0.306735375 container init 0f91a3d1a348cd412ea4a95ea1711363ce15163a407918b666f2d5296ce07574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T08:55:06.054 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:05 smithi150 podman[69006]: 2024-09-19 08:55:05.975123689 +0000 UTC m=+0.310195781 container start 0f91a3d1a348cd412ea4a95ea1711363ce15163a407918b666f2d5296ce07574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T08:55:06.054 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:06 smithi150 podman[69006]: 2024-09-19 08:55:06.054739713 +0000 UTC m=+0.389811819 container attach 0f91a3d1a348cd412ea4a95ea1711363ce15163a407918b666f2d5296ce07574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T08:55:06.316 INFO:journalctl@ceph.osd.10.smithi150.stdout:Sep 19 08:55:06 smithi150 podman[69006]: 2024-09-19 08:55:06.160682438 +0000 UTC m=+0.495754536 container died 0f91a3d1a348cd412ea4a95ea1711363ce15163a407918b666f2d5296ce07574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T08:55:06.714 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T08:55:06.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:06.752 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T08:55:06.752 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T08:55:06.752 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.11 2024-09-19T08:55:06.780 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:06.780 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:06.781 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:06.781 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:06.781 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:06.781 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:06.781 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:06.497+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:07.063 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:06 smithi162 systemd[1]: Stopping Ceph osd.11 for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:07.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.062+0000 7fb5614b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:07.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.062+0000 7fb5614b7640 -1 osd.11 94 *** Got signal Terminated *** 2024-09-19T08:55:07.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.062+0000 7fb5614b7640 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:07.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:07 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:07.525+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:08.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:08 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:08.524+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:09.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:09.918 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:09 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:09.549+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T08:54:45.979117+0000 front 2024-09-19T08:54:45.979152+0000 (oldest deadline 2024-09-19T08:55:09.479177+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:10.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:10 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:10.545+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T08:54:45.979117+0000 front 2024-09-19T08:54:45.979152+0000 (oldest deadline 2024-09-19T08:55:09.479177+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T08:53:41.670549+0000 front 2024-09-19T08:53:41.670678+0000 (oldest deadline 2024-09-19T08:54:06.370576+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T08:53:58.672920+0000 front 2024-09-19T08:53:58.672903+0000 (oldest deadline 2024-09-19T08:54:22.172834+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T08:54:03.873949+0000 front 2024-09-19T08:54:03.874103+0000 (oldest deadline 2024-09-19T08:54:29.773900+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-09-19T08:54:14.375210+0000 front 2024-09-19T08:54:14.375167+0000 (oldest deadline 2024-09-19T08:54:36.675119+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T08:54:21.375913+0000 front 2024-09-19T08:54:21.375947+0000 (oldest deadline 2024-09-19T08:54:45.475897+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T08:54:27.777355+0000 front 2024-09-19T08:54:27.777287+0000 (oldest deadline 2024-09-19T08:54:53.077196+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-09-19T08:54:38.978249+0000 front 2024-09-19T08:54:38.978268+0000 (oldest deadline 2024-09-19T08:55:02.478161+0000) 2024-09-19T08:55:11.917 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:11 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-19T08:55:11.526+0000 7fb55dacd640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T08:54:45.979117+0000 front 2024-09-19T08:54:45.979152+0000 (oldest deadline 2024-09-19T08:55:09.479177+0000) 2024-09-19T08:55:12.695 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:12 smithi162 podman[70110]: 2024-09-19 08:55:12.424056674 +0000 UTC m=+5.463584459 container died 8fc4f53d1a6a6fc528a0e6b911a13253266564cb454ef904fb411b367046f90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T08:55:13.037 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:12 smithi162 podman[70110]: 2024-09-19 08:55:12.795418529 +0000 UTC m=+5.834946309 container cleanup 8fc4f53d1a6a6fc528a0e6b911a13253266564cb454ef904fb411b367046f90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:55:13.037 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:12 smithi162 bash[70110]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11 2024-09-19T08:55:13.366 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70124]: 2024-09-19 08:55:13.038295002 +0000 UTC m=+0.611446568 container remove 8fc4f53d1a6a6fc528a0e6b911a13253266564cb454ef904fb411b367046f90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T08:55:13.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70218]: 2024-09-19 08:55:13.269995701 +0000 UTC m=+0.015693239 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:55:13.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70218]: 2024-09-19 08:55:13.372341391 +0000 UTC m=+0.118038959 container create a066ce1630e67daf8e100aab723e52de421ffe3c223c229f667716708a6c1585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:13.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70218]: 2024-09-19 08:55:13.583026703 +0000 UTC m=+0.328724225 container init a066ce1630e67daf8e100aab723e52de421ffe3c223c229f667716708a6c1585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T08:55:13.667 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70218]: 2024-09-19 08:55:13.586243636 +0000 UTC m=+0.331941161 container start a066ce1630e67daf8e100aab723e52de421ffe3c223c229f667716708a6c1585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T08:55:14.076 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70218]: 2024-09-19 08:55:13.67445491 +0000 UTC m=+0.420152460 container attach a066ce1630e67daf8e100aab723e52de421ffe3c223c229f667716708a6c1585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-19T08:55:14.076 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 08:55:13 smithi162 podman[70218]: 2024-09-19 08:55:13.775569224 +0000 UTC m=+0.521266765 container died a066ce1630e67daf8e100aab723e52de421ffe3c223c229f667716708a6c1585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T08:55:14.366 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T08:55:14.444 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:14.444 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T08:55:14.445 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T08:55:14.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.a 2024-09-19T08:55:14.790 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:55:14 smithi018 systemd[1]: Stopping Ceph mds.a for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:15.194 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:55:14 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-a[71565]: 2024-09-19T08:55:14.789+0000 7fdc28650640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:15.195 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:55:14 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-a[71565]: 2024-09-19T08:55:14.789+0000 7fdc28650640 -1 mds.a *** got signal Terminated *** 2024-09-19T08:55:17.989 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:55:17 smithi018 podman[108615]: 2024-09-19 08:55:17.70192335 +0000 UTC m=+3.027701334 container died 47a4a74282f7adb364b167a0e6d63411188cb5671bc0acdd318128538b450763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T08:55:18.331 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:55:18 smithi018 podman[108615]: 2024-09-19 08:55:18.089644592 +0000 UTC m=+3.415422564 container cleanup 47a4a74282f7adb364b167a0e6d63411188cb5671bc0acdd318128538b450763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T08:55:18.332 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 08:55:18 smithi018 bash[108615]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-a 2024-09-19T08:55:18.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T08:55:18.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:18.519 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T08:55:18.519 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T08:55:18.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.d 2024-09-19T08:55:18.851 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:55:18 smithi018 systemd[1]: Stopping Ceph mds.d for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:19.193 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:55:18 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d[70274]: 2024-09-19T08:55:18.850+0000 7fcd7d6ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:19.194 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:55:18 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d[70274]: 2024-09-19T08:55:18.850+0000 7fcd7d6ae640 -1 mds.d *** got signal Terminated *** 2024-09-19T08:55:21.694 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:55:21 smithi018 podman[108748]: 2024-09-19 08:55:21.436114082 +0000 UTC m=+2.688069686 container died 7b98b55aeb0c4be9ec556d8ccba087966dba9b3ff8d5e414c90473402d9d8dd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:55:22.085 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:55:21 smithi018 podman[108748]: 2024-09-19 08:55:21.801472947 +0000 UTC m=+3.053428551 container cleanup 7b98b55aeb0c4be9ec556d8ccba087966dba9b3ff8d5e414c90473402d9d8dd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:22.085 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 08:55:21 smithi018 bash[108748]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-d 2024-09-19T08:55:22.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T08:55:22.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:22.273 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T08:55:22.273 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T08:55:22.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.g 2024-09-19T08:55:22.605 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:22 smithi018 systemd[1]: Stopping Ceph mds.g for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:22.943 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:22 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g[71143]: 2024-09-19T08:55:22.604+0000 7f5921343640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:22.943 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:22 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g[71143]: 2024-09-19T08:55:22.604+0000 7f5921343640 -1 mds.g *** got signal Terminated *** 2024-09-19T08:55:26.680 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:26 smithi018 podman[108867]: 2024-09-19 08:55:26.378661121 +0000 UTC m=+3.887498463 container died 4bb638834fd6dac040d120e6a5c949eb462f94c48ef51697cc7d140b8eb84f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:55:26.943 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:26 smithi018 podman[108867]: 2024-09-19 08:55:26.780181308 +0000 UTC m=+4.289018641 container cleanup 4bb638834fd6dac040d120e6a5c949eb462f94c48ef51697cc7d140b8eb84f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T08:55:26.944 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:26 smithi018 bash[108867]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g 2024-09-19T08:55:27.217 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 08:55:26 smithi018 podman[108879]: 2024-09-19 08:55:26.956588468 +0000 UTC m=+0.569413972 container remove 4bb638834fd6dac040d120e6a5c949eb462f94c48ef51697cc7d140b8eb84f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T08:55:27.221 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T08:55:27.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:27.255 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T08:55:27.255 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T08:55:27.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.j 2024-09-19T08:55:27.583 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:55:27 smithi018 systemd[1]: Stopping Ceph mds.j for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:27.943 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:55:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j[69867]: 2024-09-19T08:55:27.583+0000 7f5b628d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:27.944 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:55:27 smithi018 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j[69867]: 2024-09-19T08:55:27.583+0000 7f5b628d6640 -1 mds.j *** got signal Terminated *** 2024-09-19T08:55:29.916 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:55:29 smithi018 podman[108987]: 2024-09-19 08:55:29.650440601 +0000 UTC m=+2.174757734 container died 9078a9be863aa4d66e883247a63b092b9e4e7caa5ee4e4477c06e8f307d26dea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:55:30.193 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:55:30 smithi018 podman[108987]: 2024-09-19 08:55:30.019796251 +0000 UTC m=+2.544113381 container cleanup 9078a9be863aa4d66e883247a63b092b9e4e7caa5ee4e4477c06e8f307d26dea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T08:55:30.194 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 08:55:30 smithi018 bash[108987]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-j 2024-09-19T08:55:30.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T08:55:30.473 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:30.473 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T08:55:30.473 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T08:55:30.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.b 2024-09-19T08:55:30.776 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:55:30 smithi150 systemd[1]: Stopping Ceph mds.b for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:31.065 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:55:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: 2024-09-19T08:55:30.776+0000 7f50aac9c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:31.065 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:55:30 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b[64595]: 2024-09-19T08:55:30.776+0000 7f50aac9c640 -1 mds.b *** got signal Terminated *** 2024-09-19T08:55:33.065 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:55:32 smithi150 podman[69120]: 2024-09-19 08:55:32.788354952 +0000 UTC m=+2.115747551 container died 5ac16a95de5c224e21f85df7575b7972a43d2709a7b5b2da2cbd0dd62a95644d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:33.418 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:55:33 smithi150 podman[69120]: 2024-09-19 08:55:33.209475023 +0000 UTC m=+2.536867615 container cleanup 5ac16a95de5c224e21f85df7575b7972a43d2709a7b5b2da2cbd0dd62a95644d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T08:55:33.419 INFO:journalctl@ceph.mds.b.smithi150.stdout:Sep 19 08:55:33 smithi150 bash[69120]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-b 2024-09-19T08:55:33.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T08:55:33.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:33.669 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T08:55:33.669 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T08:55:33.669 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.e 2024-09-19T08:55:34.065 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:33 smithi150 systemd[1]: Stopping Ceph mds.e for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:34.065 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e[63979]: 2024-09-19T08:55:33.971+0000 7fc320e5e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:34.065 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:33 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e[63979]: 2024-09-19T08:55:33.971+0000 7fc320e5e640 -1 mds.e *** got signal Terminated *** 2024-09-19T08:55:36.513 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:36 smithi150 podman[69242]: 2024-09-19 08:55:36.20374246 +0000 UTC m=+2.316757266 container died 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:36.513 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:36 smithi150 podman[69242]: 2024-09-19 08:55:36.513684106 +0000 UTC m=+2.626698985 container cleanup 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T08:55:36.815 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:36 smithi150 bash[69242]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e 2024-09-19T08:55:36.815 INFO:journalctl@ceph.mds.e.smithi150.stdout:Sep 19 08:55:36 smithi150 podman[69257]: 2024-09-19 08:55:36.689831261 +0000 UTC m=+0.486006297 container remove 0deda23b21cc312cb936b3f5e31b8050633041ace783199e07ebb05eccec55b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:36.936 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T08:55:36.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:36.968 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T08:55:36.968 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T08:55:36.969 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.h 2024-09-19T08:55:37.283 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:55:37 smithi150 systemd[1]: Stopping Ceph mds.h for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:37.565 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:55:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h[64280]: 2024-09-19T08:55:37.283+0000 7f7ae66f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:37.565 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:55:37 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h[64280]: 2024-09-19T08:55:37.283+0000 7f7ae66f5640 -1 mds.h *** got signal Terminated *** 2024-09-19T08:55:40.315 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:55:40 smithi150 podman[69363]: 2024-09-19 08:55:40.031226764 +0000 UTC m=+2.849334652 container died 74d2786b59f0a290b605bfc8da254265add7b6f6888889de9ec4580643300d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:55:40.761 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:55:40 smithi150 podman[69363]: 2024-09-19 08:55:40.500873929 +0000 UTC m=+3.318981814 container cleanup 74d2786b59f0a290b605bfc8da254265add7b6f6888889de9ec4580643300d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T08:55:40.761 INFO:journalctl@ceph.mds.h.smithi150.stdout:Sep 19 08:55:40 smithi150 bash[69363]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-h 2024-09-19T08:55:40.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T08:55:40.969 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:40.969 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T08:55:40.969 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T08:55:40.969 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.k 2024-09-19T08:55:41.315 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:55:41 smithi150 systemd[1]: Stopping Ceph mds.k for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:41.815 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:55:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-k[63666]: 2024-09-19T08:55:41.321+0000 7f54b3610640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:41.816 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:55:41 smithi150 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-k[63666]: 2024-09-19T08:55:41.321+0000 7f54b3610640 -1 mds.k *** got signal Terminated *** 2024-09-19T08:55:45.646 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:55:45 smithi150 podman[69497]: 2024-09-19 08:55:45.334055995 +0000 UTC m=+4.149174185 container died 24a880c561b48895d96f930dbfee7c9d54d70146141c6f9a87db2f8d79b8ddb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:55:45.946 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:55:45 smithi150 podman[69497]: 2024-09-19 08:55:45.729731856 +0000 UTC m=+4.544850043 container cleanup 24a880c561b48895d96f930dbfee7c9d54d70146141c6f9a87db2f8d79b8ddb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:45.946 INFO:journalctl@ceph.mds.k.smithi150.stdout:Sep 19 08:55:45 smithi150 bash[69497]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-k 2024-09-19T08:55:46.077 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T08:55:46.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:46.111 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T08:55:46.111 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T08:55:46.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.c 2024-09-19T08:55:46.399 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:55:46 smithi162 systemd[1]: Stopping Ceph mds.c for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:46.667 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:55:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c[65045]: 2024-09-19T08:55:46.398+0000 7f351654c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:46.667 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:55:46 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c[65045]: 2024-09-19T08:55:46.398+0000 7f351654c640 -1 mds.c *** got signal Terminated *** 2024-09-19T08:55:49.657 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:55:49 smithi162 podman[70319]: 2024-09-19 08:55:49.330856162 +0000 UTC m=+3.017796486 container died 1235ebeb97429a435acb3d20ebe4c7232213b4befe5d026e94dfb2d3f8a0b761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:55:49.917 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:55:49 smithi162 podman[70319]: 2024-09-19 08:55:49.766309676 +0000 UTC m=+3.453249995 container cleanup 1235ebeb97429a435acb3d20ebe4c7232213b4befe5d026e94dfb2d3f8a0b761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T08:55:49.917 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 08:55:49 smithi162 bash[70319]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-c 2024-09-19T08:55:50.191 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T08:55:50.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:50.228 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T08:55:50.228 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T08:55:50.229 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.f 2024-09-19T08:55:50.561 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:50 smithi162 systemd[1]: Stopping Ceph mds.f for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:50.917 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-f[64739]: 2024-09-19T08:55:50.561+0000 7f62d444a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:50.917 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:50 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-f[64739]: 2024-09-19T08:55:50.561+0000 7f62d444a640 -1 mds.f *** got signal Terminated *** 2024-09-19T08:55:54.844 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:54 smithi162 podman[70451]: 2024-09-19 08:55:54.57554713 +0000 UTC m=+4.117556703 container died 68f85d3ded1a7d1fef3882e18278b89964897c18106a40757defd930170b4130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T08:55:54.844 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:54 smithi162 podman[70451]: 2024-09-19 08:55:54.844787744 +0000 UTC m=+4.386797312 container cleanup 68f85d3ded1a7d1fef3882e18278b89964897c18106a40757defd930170b4130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T08:55:55.166 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:54 smithi162 bash[70451]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-f 2024-09-19T08:55:55.167 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 08:55:55 smithi162 podman[70463]: 2024-09-19 08:55:55.070881455 +0000 UTC m=+0.492321405 container remove 68f85d3ded1a7d1fef3882e18278b89964897c18106a40757defd930170b4130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T08:55:55.198 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T08:55:55.232 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:55.233 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T08:55:55.233 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T08:55:55.233 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.i 2024-09-19T08:55:55.564 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:55:55 smithi162 systemd[1]: Stopping Ceph mds.i for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:55.917 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:55:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i[65345]: 2024-09-19T08:55:55.564+0000 7f45b45de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:55.917 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:55:55 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i[65345]: 2024-09-19T08:55:55.564+0000 7f45b45de640 -1 mds.i *** got signal Terminated *** 2024-09-19T08:55:57.131 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:55:56 smithi162 podman[70575]: 2024-09-19 08:55:56.792714663 +0000 UTC m=+1.330594319 container died 5e0a2bdcc2b40572e5ffb226a41f51b13343853e091841f7a1bd10afe04e486c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:57.416 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:55:57 smithi162 podman[70575]: 2024-09-19 08:55:57.239775988 +0000 UTC m=+1.777655633 container cleanup 5e0a2bdcc2b40572e5ffb226a41f51b13343853e091841f7a1bd10afe04e486c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:57.417 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 08:55:57 smithi162 bash[70575]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-i 2024-09-19T08:55:57.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T08:55:57.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:57.746 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T08:55:57.746 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T08:55:57.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.l 2024-09-19T08:55:58.060 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:55:57 smithi162 systemd[1]: Stopping Ceph mds.l for ed3de594-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:58.416 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:55:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l[64434]: 2024-09-19T08:55:58.060+0000 7fedc59d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:58.416 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:55:58 smithi162 ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l[64434]: 2024-09-19T08:55:58.060+0000 7fedc59d6640 -1 mds.l *** got signal Terminated *** 2024-09-19T08:55:59.795 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:55:59 smithi162 podman[70691]: 2024-09-19 08:55:59.545300933 +0000 UTC m=+1.578390958 container died 19be58d02b9216a75f4a0229248b4f78dc0e88006ac073b68772f0c040ec0676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:55:59.795 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:55:59 smithi162 podman[70691]: 2024-09-19 08:55:59.793717619 +0000 UTC m=+1.826807644 container cleanup 19be58d02b9216a75f4a0229248b4f78dc0e88006ac073b68772f0c040ec0676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T08:55:59.795 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 08:55:59 smithi162 bash[70691]: ceph-ed3de594-7661-11ef-bceb-c7b262605968-mds-l 2024-09-19T08:56:00.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ed3de594-7661-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T08:56:00.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:00.383 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T08:56:00.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ed3de594-7661-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:56:00.595 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:56:03.276 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ed3de594-7661-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi150.stdout:Deleting cluster with fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:56:05.831 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ed3de594-7661-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:56:06.032 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:56:08.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:56:08.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:56:08.497 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:56:08.524 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T08:56:08.527 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi018/crash 2024-09-19T08:56:08.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:56:08.567 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:56:08.567 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:56:08.569 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi150/crash 2024-09-19T08:56:08.570 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:56:08.613 INFO:teuthology.orchestra.run.smithi150.stderr:tar: /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:56:08.614 INFO:teuthology.orchestra.run.smithi150.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:56:08.615 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi162/crash 2024-09-19T08:56:08.616 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:56:08.653 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/ed3de594-7661-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:56:08.653 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:56:08.654 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T08:56:08.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T08:56:08.694 INFO:tasks.cephadm:Compressing logs... 2024-09-19T08:56:08.694 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:56:08.737 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:56:08.739 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:56:08.764 INFO:teuthology.orchestra.run.smithi150.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T08:56:08.764 INFO:teuthology.orchestra.run.smithi150.stderr:: No such file or directory 2024-09-19T08:56:08.764 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:56:08.765 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:56:08.772 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:56:08.772 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-19T08:56:08.772 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:56:08.772 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T08:56:08.772 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T08:56:08.772 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.11.log: 82.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr: 90.5% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr: 94.9% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T08:56:08.773 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T08:56:08.785 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T08:56:08.785 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:56:08.786 INFO:teuthology.orchestra.run.smithi162.stderr: 92.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T08:56:08.786 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T08:56:08.786 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:56:08.786 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T08:56:08.786 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log: 94.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T08:56:08.786 INFO:teuthology.orchestra.run.smithi162.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:56:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-19T08:56:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:: No such file or directory 2024-09-19T08:56:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T08:56:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T08:56:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:56:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr: 82.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log: 94.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr: 94.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T08:56:08.789 INFO:teuthology.orchestra.run.smithi018.stderr: 86.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr: 94.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/ceph-client.0.log: 90.9% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/cephadm.log: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.y.log 94.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T08:56:08.790 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.y.log: /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log: 86.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr: 91.0% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr: 94.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:56:08.791 INFO:teuthology.orchestra.run.smithi150.stderr: 94.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T08:56:08.986 INFO:teuthology.orchestra.run.smithi162.stderr: 91.9% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T08:56:09.020 INFO:teuthology.orchestra.run.smithi018.stderr: 90.3% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T08:56:09.093 INFO:teuthology.orchestra.run.smithi150.stderr: 91.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T08:56:09.795 INFO:teuthology.orchestra.run.smithi018.stderr: 90.4% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T08:56:11.366 INFO:teuthology.orchestra.run.smithi162.stderr: 95.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T08:56:18.388 INFO:teuthology.orchestra.run.smithi162.stderr: 91.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T08:56:19.017 INFO:teuthology.orchestra.run.smithi150.stderr: 92.2% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T08:56:25.838 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T08:56:28.115 INFO:teuthology.orchestra.run.smithi150.stderr: 91.9% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T08:56:28.131 INFO:teuthology.orchestra.run.smithi150.stderr: 91.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T08:56:28.355 INFO:teuthology.orchestra.run.smithi018.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T08:56:28.978 INFO:teuthology.orchestra.run.smithi018.stderr: 92.0% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T08:56:30.828 INFO:teuthology.orchestra.run.smithi150.stderr: 91.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T08:56:35.739 INFO:teuthology.orchestra.run.smithi162.stderr: 91.7% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T08:56:36.876 INFO:teuthology.orchestra.run.smithi018.stderr: 91.8% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T08:56:37.965 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T08:56:37.967 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-19T08:56:37.967 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m29.213s 2024-09-19T08:56:37.967 INFO:teuthology.orchestra.run.smithi162.stderr:user 1m22.890s 2024-09-19T08:56:37.967 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m2.694s 2024-09-19T08:56:44.458 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T08:56:44.460 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-19T08:56:44.460 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m35.708s 2024-09-19T08:56:44.460 INFO:teuthology.orchestra.run.smithi150.stderr:user 1m43.468s 2024-09-19T08:56:44.460 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m3.408s 2024-09-19T08:56:45.272 INFO:teuthology.orchestra.run.smithi018.stderr: 91.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T08:56:47.356 INFO:teuthology.orchestra.run.smithi018.stderr: 91.6% -- replaced with /var/log/ceph/ed3de594-7661-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T08:56:47.357 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T08:56:47.357 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m38.607s 2024-09-19T08:56:47.357 INFO:teuthology.orchestra.run.smithi018.stderr:user 2m20.047s 2024-09-19T08:56:47.357 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m4.006s 2024-09-19T08:56:47.359 INFO:tasks.cephadm:Archiving logs... 2024-09-19T08:56:47.359 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi018/log 2024-09-19T08:56:47.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:57:10.143 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi150/log 2024-09-19T08:57:10.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:57:26.530 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi162/log 2024-09-19T08:57:26.531 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:57:41.154 INFO:tasks.cephadm:Removing cluster... 2024-09-19T08:57:41.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ed3de594-7661-11ef-bceb-c7b262605968 --force 2024-09-19T08:57:41.368 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:57:41.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ed3de594-7661-11ef-bceb-c7b262605968 --force 2024-09-19T08:57:42.009 INFO:teuthology.orchestra.run.smithi150.stdout:Deleting cluster with fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:57:42.409 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ed3de594-7661-11ef-bceb-c7b262605968 --force 2024-09-19T08:57:42.613 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: ed3de594-7661-11ef-bceb-c7b262605968 2024-09-19T08:57:43.001 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T08:57:43.001 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:57:43.021 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:57:43.039 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:57:43.055 INFO:tasks.cephadm:Teardown complete 2024-09-19T08:57:43.056 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T08:57:43.066 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T08:57:43.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:57:43.069 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:57:43.081 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:57:43.186 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T08:57:43.195 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T08:57:43.196 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:57:43.199 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:57:43.201 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:57:43.214 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:57:43.214 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:57:43.216 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:57:43.218 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:57:43.218 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-19T08:57:43.218 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +1316us[+1345us] +/- 38ms 2024-09-19T08:57:43.219 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -3776us[-3776us] +/- 63ms 2024-09-19T08:57:43.219 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +1746us[+1774us] +/- 61ms 2024-09-19T08:57:43.219 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T08:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +1342us[+1375us] +/- 38ms 2024-09-19T08:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -3750us[-3750us] +/- 63ms 2024-09-19T08:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1767us[+1767us] +/- 61ms 2024-09-19T08:57:43.222 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:57:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:57:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T08:57:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +1313us[+1367us] +/- 38ms 2024-09-19T08:57:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -3764us[-3764us] +/- 63ms 2024-09-19T08:57:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +1744us[+1744us] +/- 61ms 2024-09-19T08:57:43.223 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:57:43.223 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T08:57:43.233 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T08:57:43.234 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T08:57:43.289 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:57:43.375 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:57:43.448 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:57:43.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:57:43.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:57:43.547 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:57:43.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:57:43.577 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:57:43.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:57:43.605 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T08:57:43.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T08:57:43.662 INFO:teuthology.task.internal:Duration was 1768.033880 seconds 2024-09-19T08:57:43.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T08:57:43.687 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T08:57:43.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:57:43.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:57:43.693 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:57:43.731 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:57:43.732 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:57:43.733 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:57:44.203 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T08:57:44.203 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T08:57:44.203 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:57:44.226 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-19T08:57:44.227 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:57:44.258 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T08:57:44.258 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:57:44.287 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T08:57:44.287 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:57:44.290 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:57:44.300 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:57:44.354 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T08:57:44.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:57:44.358 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:57:44.366 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:57:44.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T08:57:44.861 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T08:57:44.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:57:44.888 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:57:44.914 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:57:44.939 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T08:57:45.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:57:45.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:57:45.048 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:57:45.067 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-19T08:57:45.068 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-19T08:57:45.071 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-19T08:57:45.107 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:57:45.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:57:45.136 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:57:45.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:57:45.162 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:57:45.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:57:45.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T08:57:45.188 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T08:57:45.189 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi018 2024-09-19T08:57:45.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:57:45.236 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi150 2024-09-19T08:57:45.237 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:57:45.273 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911854/remote/smithi162 2024-09-19T08:57:45.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:57:45.309 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T08:57:45.309 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:57:45.312 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:57:45.314 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:57:45.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T08:57:45.371 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T08:57:45.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T08:57:45.409 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T08:57:45.409 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:57:45.412 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:57:45.414 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:57:45.425 INFO:teuthology.orchestra.run.smithi018.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:57 /home/ubuntu/cephtest 2024-09-19T08:57:45.426 INFO:teuthology.orchestra.run.smithi150.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:57 /home/ubuntu/cephtest 2024-09-19T08:57:45.428 INFO:teuthology.orchestra.run.smithi162.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:57 /home/ubuntu/cephtest 2024-09-19T08:57:45.430 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T08:57:45.451 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T08:57:45.499 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} duration: 1768.0338802337646 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T08:57:45.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:57:45.602 INFO:teuthology.run:pass